-- Logs begin at Mon 2022-08-08 17:10:30 UTC, end at Mon 2022-08-08 18:29:13 UTC. -- Aug 08 18:00:33.451398 dv-cinder-852364-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 18:00:33.460445 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 18:00:33 2022] *** Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: nodename: dv-cinder-852364-1-iscsi Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: machine: x86_64 Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: clock source: unix Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: pcre jit disabled Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: detected number of CPU cores: 4 Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: current working directory: / Aug 08 18:00:33.462418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: detected binary path: /usr/bin/uwsgi-core Aug 08 18:00:33.463163 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: your processes number limit is 47680 Aug 08 18:00:33.463163 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: your memory page size is 4096 bytes Aug 08 18:00:33.463163 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: detected max file descriptor number: 2048 Aug 08 18:00:33.463163 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: lock engine: pthread robust mutexes Aug 08 18:00:33.463163 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: thunder lock: enabled Aug 08 18:00:33.463163 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 18:00:33.463163 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 18:00:33.502418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: Python main interpreter initialized at 0x5626487c39c0 Aug 08 18:00:33.502418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: python threads support enabled Aug 08 18:00:33.502418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: your server socket listen backlog is limited to 100 connections Aug 08 18:00:33.502418 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: your mercy for graceful operations on workers is 90 seconds Aug 08 18:00:33.502764 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 18:00:33.502842 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: *** Operational MODE: preforking *** Aug 08 18:00:33.503081 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: *** uWSGI is running in multiple interpreter mode *** Aug 08 18:00:33.503081 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: spawned uWSGI master process (pid: 103846) Aug 08 18:00:33.503273 dv-cinder-852364-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 18:00:33.503821 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: spawned uWSGI worker 1 (pid: 103847, cores: 1) Aug 08 18:00:33.504193 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: spawned uWSGI worker 2 (pid: 103848, cores: 1) Aug 08 18:00:33.504352 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 18:00:34.164711 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 18:00:34.167769 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 18:00:35.243791 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 18:00:35.243791 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: from cryptography.utils import int_from_bytes Aug 08 18:00:35.244337 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 18:00:35.244337 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: from cryptography.utils import int_from_bytes Aug 08 18:00:35.249413 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 18:00:35.249413 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: from cryptography.utils import int_from_bytes Aug 08 18:00:35.249880 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 18:00:35.249880 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: from cryptography.utils import int_from_bytes Aug 08 18:00:37.708387 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 18:00:37.709095 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 18:00:37.709194 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 18:00:37.709522 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 18:00:37.709782 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 18:00:37.710167 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.710491 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.710812 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.711130 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.711460 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.711644 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 18:00:37.712006 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.712096 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 18:00:37.712182 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.712381 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.712478 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 18:00:37.712725 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.712822 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 18:00:37.712994 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.713144 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 18:00:37.713307 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.713411 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.713631 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-1-iscsi {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.713719 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.713952 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.714039 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.714260 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.714359 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.714576 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.714662 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.714877 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.714961 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.715183 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.715270 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.715492 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.715592 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.715802 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.715910 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.716058 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.716297 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.716401 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.717459 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-1-iscsi {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.717568 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.717651 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.717719 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.718395 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.718484 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.718552 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.718629 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.718704 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.718777 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.718843 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.718913 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.719172 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.719374 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.719457 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.719531 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.719768 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.719877 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.720081 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.720198 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.720396 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.720498 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-1-iscsi {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.720729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.720840 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.721058 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.721180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.721367 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.721463 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.721672 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.721802 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.721988 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.722116 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.722291 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.722426 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.722613 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.722746 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.722918 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.723073 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.723302 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-1-iscsi {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.723411 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.723608 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.723709 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.723916 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.724009 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.724216 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.724302 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.724648 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.724744 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.724954 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.725041 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.725255 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.725339 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.725564 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.725658 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.725879 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.726003 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.726183 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.726268 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.726491 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.726586 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.726745 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.726830 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.727055 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.727150 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.727380 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.727480 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.727689 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.727781 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.727992 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.728128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.728248 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.728354 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.728490 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.728630 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.728834 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.728924 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.729157 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.729245 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.729426 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.729523 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.729726 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.729827 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.730043 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.730138 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.730347 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.730435 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.730655 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.730755 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.730901 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.730993 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.731152 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.731273 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.731466 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.731577 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.731781 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.731880 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.732084 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.732181 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.732391 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.732488 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.732719 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.732823 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.733021 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.733108 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.733323 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.733498 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.733647 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.733756 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.733950 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.734069 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.734252 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.734412 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.734565 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.734732 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.734877 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.735043 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.735194 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.735367 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.735482 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.735685 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.735798 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.735993 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.736189 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.736285 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.736437 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.736620 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.736765 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.736945 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.737100 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.737279 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.737416 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.737585 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.737720 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.737839 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.738034 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.738130 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.738347 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.738434 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.738647 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.738747 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.738947 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.739034 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.739250 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.739335 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.739565 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.739671 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.739888 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.739983 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.740188 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.740294 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.740434 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.740552 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.740755 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.740841 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.741054 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.741139 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.741366 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.741454 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.741667 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.741754 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.741965 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.742059 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.742267 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.742362 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.742560 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.742718 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.742859 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.742947 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.743156 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.743267 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.743453 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.743539 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.743752 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.743855 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.744048 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.744135 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.744346 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.744435 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.744678 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.744779 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.744980 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.745078 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.745276 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.745363 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.745587 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.745681 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.745891 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.745976 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.746189 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.746282 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.746488 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.746587 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.746784 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.746877 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.747084 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.747179 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.747395 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.747494 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.747695 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.747780 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.747991 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.748077 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.748305 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.748403 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.748626 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.748717 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.748926 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.749014 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.749258 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.749352 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.749570 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.749715 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.749856 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.749949 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.750162 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.750257 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.750454 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.750538 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.750753 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.750839 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.751050 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.751135 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.751347 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.751468 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.751646 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.751741 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.751941 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.752028 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.752244 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.752338 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.752569 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.752657 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.752870 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.752956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.753167 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.753254 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.753463 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.753556 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.753756 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.753851 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.754066 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.754159 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.754377 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.754472 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.754679 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.754806 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.754978 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.755129 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.755277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.755446 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.755587 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:00:37.755764 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.755915 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.756095 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.756239 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.756412 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.756602 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.756751 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.756917 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.757068 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.757246 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.757388 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.757575 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.757708 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.757889 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.758043 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.758197 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.758364 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.758505 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.758683 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.758828 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.759005 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.759136 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.759319 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.759442 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.759637 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.759750 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.759968 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.760073 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.760290 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.760384 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.760628 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.760763 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.760972 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.761074 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.761291 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.761387 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.761604 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.761698 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.761909 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.762006 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.762226 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.762313 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.762537 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.762622 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.762848 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.762934 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.763155 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.763241 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.763476 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.763599 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.763808 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.763904 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.764112 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.764198 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.764431 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.764549 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.765285 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.765377 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.765594 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.765682 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.765900 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.765990 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.766206 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.766295 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.766515 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.766609 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.766842 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.766938 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.767149 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.767243 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.767463 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.767549 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.767765 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.767859 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.768070 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.768157 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.768375 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.768462 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.768710 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.768807 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.769012 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.769098 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.769318 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.769411 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.769626 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.769721 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.769933 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.770019 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.770236 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.770331 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.770540 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.770640 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.770842 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.770927 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.771144 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.771230 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.771449 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.771537 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.771748 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.771844 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.772047 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.772134 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.772345 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.772434 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.772686 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.772777 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.772987 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.773138 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.773292 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.773380 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.773608 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.773737 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.773906 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.773992 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.774216 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.774310 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.774518 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.774615 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.774823 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.774920 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.775129 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.775217 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.775433 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.775520 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.775731 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.775828 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.776036 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.776125 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.776338 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.776432 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.776671 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.776772 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.776984 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.777071 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.777288 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.777373 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.777588 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.777685 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.777905 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.778000 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.778204 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.778302 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.778505 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.778595 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.778811 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.778897 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.779115 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.779206 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.779418 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.779506 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.779721 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.779807 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.780027 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.780113 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.780975 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.781076 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.781289 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.781379 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.781598 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.781695 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.781905 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.781994 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.782214 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.782302 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.782524 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.782620 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.782838 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.782925 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.783146 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.783235 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.783454 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.783568 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.783755 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.783846 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.784057 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.784143 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.784356 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.784450 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.784694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.784782 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.784996 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.785095 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.785304 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.785398 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.785600 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.785686 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.785900 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.785990 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.786201 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.786286 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.788880 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789045 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789284 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789402 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789511 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789617 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789721 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789835 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.789941 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790056 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790170 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790284 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790389 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790504 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790612 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790731 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790838 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.790942 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791046 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791150 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791354 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791434 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791513 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791590 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791669 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791755 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791846 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.791965 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792052 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792132 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792215 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792307 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792388 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792466 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792570 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792652 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792730 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792821 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.792980 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.793058 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.793135 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.793213 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.793329 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.793418 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.793655 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.793742 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.793966 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.794062 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.794265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.794350 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.794576 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.794662 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.794889 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.795053 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.795201 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.795289 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.795514 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.795608 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.795827 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.795944 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.796162 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.796257 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.796469 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.796588 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.796802 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.796933 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.797106 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.797240 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.797439 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.797681 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.797786 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.797993 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.798086 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.798309 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.798402 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.798608 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.798718 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.798920 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.799022 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.799279 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.799452 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.799595 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.799919 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.800011 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.800224 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.800323 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.800552 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.800645 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.800851 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.800965 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.801553 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.801553 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.801757 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.802069 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.802216 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.802382 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.802523 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.802694 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.802851 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.802990 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.803137 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.803301 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.803439 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.803612 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.803759 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.803923 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.804076 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.804220 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.804350 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.804545 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.804693 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.804878 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.805016 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.805190 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.805322 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.805499 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.805644 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.805811 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.805954 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.806102 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.806242 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.806389 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.806523 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.806701 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.806807 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.807012 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.807108 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.807316 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.807412 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.807619 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.807721 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.807918 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.808031 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.808228 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.808568 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.808685 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.808879 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.809013 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.809216 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.809362 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.809505 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.809637 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.809807 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.809965 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.810108 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.810281 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.810427 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.810599 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.810735 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.810915 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.811033 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.811228 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.811324 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.811584 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.811727 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.811900 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.812044 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.812210 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.812356 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.812530 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.812636 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.812847 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.812950 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.813160 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.813248 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.813465 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.813551 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.813774 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.813862 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.814080 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.814168 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.814385 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.814474 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.814691 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.814785 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.814996 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.815092 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.815301 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.815389 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.815609 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.815698 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.815914 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.816176 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.816263 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.816525 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.816628 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.816846 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.816937 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.817148 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.817249 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.817454 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.817551 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.817758 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.817850 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.818057 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.818144 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.818362 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.818450 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.818671 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.818758 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.819033 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.819226 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.819326 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.819550 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.819638 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.819860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.819947 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.820174 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.820261 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.820487 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.820597 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.820819 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.820908 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.821123 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.821209 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.821436 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.821524 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.821743 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.821837 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.822048 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.822144 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.822352 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.822456 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.822655 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.822741 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.822953 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.823049 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.823256 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.823360 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.823554 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.823647 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.823852 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.823939 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.824150 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.824239 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.824454 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.824566 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.824780 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.824877 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.825080 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.825170 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.825377 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.825465 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.825676 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.825770 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.825983 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.826071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.826279 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.826365 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.826582 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.826693 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.826881 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.827036 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.827712 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.827867 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.828261 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.828427 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.828589 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.828779 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.828876 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.829086 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.829174 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.829393 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.829489 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.829698 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.829785 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.830009 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.830104 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.830317 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.830406 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.830619 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.830706 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.830929 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.831015 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.831240 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.831328 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.831550 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.831636 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.831862 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.831958 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.832165 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.832252 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.832463 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.832572 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.832787 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.832890 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.833095 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.833181 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.833394 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.833488 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.833695 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.833798 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.833994 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.834091 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.834298 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.834384 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.834602 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.834698 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.834897 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.834984 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.835200 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.835286 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.835498 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.835586 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.835808 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.835894 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.836110 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.836196 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.836404 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.836491 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.836730 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.836824 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.837032 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.837121 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.837333 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.837422 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.837630 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.837717 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.837932 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.838020 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.838227 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.838315 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.838534 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.838620 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.838831 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.838926 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.839129 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.839223 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.839426 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.839516 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.839726 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.839822 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.840025 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.840111 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.840324 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.840411 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.840665 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.840770 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.840971 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.841058 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.841271 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.841357 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.841571 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.841704 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.841877 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.841971 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.842174 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.842260 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.842472 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.842560 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.842822 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.843397 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.843622 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.843753 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.843928 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.844031 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.844234 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.844334 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.844557 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.844657 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.844870 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.844967 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.845174 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.845273 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.845474 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.845572 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.845777 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.845874 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.846072 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.846177 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.846373 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.846485 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.846672 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.846770 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.846975 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.847085 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.847278 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.847375 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.847599 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.847686 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.847906 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.848000 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.848207 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.848305 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.848559 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.848665 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.848830 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.848991 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.849168 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.849336 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.849459 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.849547 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.849789 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.849876 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.850092 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.850192 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.850393 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.850479 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.850700 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.850795 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.851003 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.851090 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.851310 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.851402 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.851620 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.851770 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.851924 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.852061 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.852214 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.852350 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.852494 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.852649 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.852833 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.852922 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.853133 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.853221 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.853437 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.853525 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.853753 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.853842 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.854058 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.854146 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.854362 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.854462 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.854670 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.854763 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.854983 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.855078 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.855296 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.855393 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.855593 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.855686 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.855897 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.855984 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.856201 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.856300 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.856554 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.856657 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.856827 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.856914 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.857128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.857222 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.857431 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.857518 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.857739 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.857832 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.858041 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.858128 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.858341 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.858446 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.858668 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.858756 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.858969 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.859057 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.859272 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.859356 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.859573 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.859704 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.859871 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.860017 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.860188 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.860330 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.860493 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.860664 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.860809 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.860979 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.861104 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.861289 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.861402 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.861605 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.861693 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.861919 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.862013 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.862226 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.862394 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.862642 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.862731 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.862953 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.863040 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.863264 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.863352 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.863574 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.863660 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.863878 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.863963 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.864183 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.864270 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.864487 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.864599 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.864809 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.864896 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.865122 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.865220 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.865435 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.865522 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.865739 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.865826 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.866064 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.866165 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.866362 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.866455 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.866659 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.866746 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.866960 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.867082 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.867274 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.867396 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.867571 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.867702 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.867868 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.868118 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.868207 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.868431 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.868537 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.868768 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.868869 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.869081 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.869175 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.869405 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.869491 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.869731 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.869826 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.870039 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.870135 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.870353 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.870440 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.870668 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.870768 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.870997 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.871091 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.871321 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.871424 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.871631 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.871719 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.871945 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.872039 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.872246 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.872332 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.872570 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.872660 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.872879 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.872993 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.873196 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.873284 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.873514 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.873607 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.873817 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.873929 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.874155 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.874302 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.874458 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.874612 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.874777 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.874936 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.875093 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.875264 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.875400 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.875578 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.875714 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.875884 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.876119 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.876206 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.876436 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.876558 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.876768 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.876857 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.877085 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.877171 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.877405 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.877501 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.877706 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.877801 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.878006 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.878093 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.878309 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.878404 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.878611 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.878700 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.878910 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.878996 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.879227 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.879323 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.879526 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.879614 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.879831 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.879917 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.880134 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.880229 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.880436 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.880542 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.880765 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.880853 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.881065 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.881154 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.881382 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.881479 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.881682 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.881771 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.881985 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.882067 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.882291 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.882383 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.882596 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.882689 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.882908 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.882997 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.883209 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.883296 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.883530 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.883617 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.883834 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.883922 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.884133 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.884220 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.884431 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.884575 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.884754 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.884843 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.885090 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.885178 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.885391 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.885491 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.885707 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.885794 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.886032 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.886119 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.886335 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.886430 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.886642 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.886730 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.886954 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.887041 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.887259 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.887355 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.887565 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.887661 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.887869 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.887957 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.888179 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.888270 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.888476 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.888627 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.888798 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.888887 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.889103 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.889192 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.889401 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.889487 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.890229 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.890332 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.890526 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.890616 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.890828 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.890915 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.891126 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.891223 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.891423 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.891510 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.891721 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.891806 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.892038 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.892133 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.892337 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.892433 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.892674 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.892764 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.892978 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.893078 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.893277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.893365 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.893574 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.893673 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.893876 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.893973 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.894212 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.894307 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.894511 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.894607 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.894833 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.894921 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.895138 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.895227 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.895448 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.895535 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.895755 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.895843 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.896063 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.896149 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.896372 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.896460 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.896704 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.896794 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.897013 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.897229 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.897317 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.897564 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.897661 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.897882 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.897971 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.898196 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.898281 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.898503 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.898608 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.898812 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.898900 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.899125 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.899325 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.899421 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.899647 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.899735 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.899956 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.900043 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.900263 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.900358 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.900594 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.900686 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.900906 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.900993 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.901213 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.901312 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.901517 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.901605 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.901820 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.901963 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.902123 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.902212 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.902424 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.902528 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.902744 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.902833 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.903060 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.903149 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.903379 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.903477 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.903707 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.903827 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.904022 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.904154 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.904327 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.904415 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.904656 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.904760 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.904965 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.905052 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.905323 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.905907 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.906144 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.906233 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.906461 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.906560 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.906777 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.906922 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.907091 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.907188 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.907400 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.907487 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.907709 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.907795 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.908015 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.908104 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.908322 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.908417 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.908653 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.908755 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.908962 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.909050 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.909267 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.909354 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.909575 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.909680 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.909882 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.910100 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.910195 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.910422 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.910510 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.910762 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.910851 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.911094 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.911189 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.911405 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.911500 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.911715 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.911809 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.912038 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.912224 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.912370 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.912558 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.912713 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.912888 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.913023 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.913208 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.913339 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.913528 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.913652 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.913839 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.913959 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.914155 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.914283 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.914473 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.914596 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.914773 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.914903 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.915071 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.915224 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.915375 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.915536 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.915676 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.915976 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.916062 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.916291 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.916407 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.916620 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.916753 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.916919 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.917081 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.917232 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.917408 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.917534 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.917727 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.918036 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.918121 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.918362 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.918452 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.918672 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.918759 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.918980 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.919081 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.919297 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.919385 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.919609 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.919703 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.919909 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.920004 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.920211 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.920297 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.920537 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.920628 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.920862 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.920965 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.921180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.921266 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.921485 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.921571 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.921786 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.921882 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.922085 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.922173 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.922391 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.922478 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.922697 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.922794 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.922996 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.923084 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.923298 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.923385 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.923597 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.923686 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.923901 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.923987 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.924210 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.924297 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.924523 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.924612 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.924829 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.924926 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.925132 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.925226 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.925427 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.925521 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.925725 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.925813 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.926026 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.926126 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.926324 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.926412 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.926630 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.926717 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.926928 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.927024 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.927233 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.927320 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.927531 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.927618 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.927835 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.927930 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.928133 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.928221 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.928435 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.928542 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.928761 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.928862 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.929080 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.929169 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.929379 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.929472 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.929723 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.929812 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.930034 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.930124 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.930342 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.930583 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.930680 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.930920 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.931015 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.931244 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.931331 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.931579 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.931679 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.931888 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.931975 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.932209 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.932408 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.932556 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.932761 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.932858 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.933075 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.933162 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.933402 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.933503 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.933727 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.933823 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.934036 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.934121 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.934335 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.934429 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.934635 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.934729 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.934943 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.935030 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.935246 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.935341 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.935553 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.935639 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.935854 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.935946 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.936157 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.936245 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.936459 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.937086 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.937317 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.937404 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.937621 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.937709 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.937927 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.938059 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.938228 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.938323 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.938531 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.938619 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.938833 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.938927 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.939135 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.939231 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.939439 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.939527 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.939740 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.939827 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.940047 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.940143 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.940364 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.940449 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.940699 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.940790 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.941007 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.941114 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.941317 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.941405 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.941626 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.941713 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.941931 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.942035 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.942234 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.942320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.942534 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.942647 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.942838 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.942960 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.943144 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.943280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.943464 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.943600 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.943771 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.943910 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.944234 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.944398 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.944630 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.944844 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.944946 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.945151 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.945239 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.945466 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.945554 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.945783 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.945872 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.946087 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.946183 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.946403 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.946490 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.946722 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.946814 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.947027 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.947114 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.947335 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.947428 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.947638 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.947726 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.947946 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.948030 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.948265 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.948372 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.948602 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.948707 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.948908 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.949005 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.949211 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.949308 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.949510 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.949605 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.949810 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.949896 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.950111 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.950205 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.950411 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.950497 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.950714 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.950848 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.951013 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.951111 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.951311 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.951397 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.951611 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.951710 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.951908 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.951996 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.952256 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.952936 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.953324 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.953415 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.953626 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.953716 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.953928 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.954016 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.954231 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.954317 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.954538 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.954627 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.954843 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.954930 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.955139 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.955233 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.955439 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.955527 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.955736 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.955821 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.956040 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.956136 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.956337 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.956425 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.956658 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.956748 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.956955 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.957055 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.957252 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.957340 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.957547 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.957643 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.957873 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.957979 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.958200 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.958289 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.958558 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.958652 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.958828 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.958917 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.959134 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.959222 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.959449 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.959545 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.959752 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.959841 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.960059 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.960145 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.960373 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.960470 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.960704 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.960800 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.961009 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.961111 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.961334 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.961421 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.961638 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.961735 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.961941 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.962030 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.962245 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.962343 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.962551 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.962640 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.962853 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.962981 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.963157 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.963254 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.963471 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.963565 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.963787 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.963873 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.964088 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.964184 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.964395 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.964481 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.964730 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.964819 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.965041 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.965131 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.965350 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.965436 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.965656 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.965745 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.965965 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.966052 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.966272 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.966359 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.966578 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.966666 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.966883 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.966979 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.967187 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.967284 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.967492 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.967588 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.967824 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.967916 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.968128 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.968223 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.968436 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.968564 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.968789 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.968878 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.969103 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.969190 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.969426 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.969521 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.969747 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.969842 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.970053 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.970140 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.970366 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.970461 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.970675 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.970771 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.970920 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 18:00:37.971009 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.971308 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.971643 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.971967 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.972276 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.972610 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.972914 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:00:37.973154 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 18:00:38.122723 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO dbcounter [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Registered counter for database nova_api Aug 08 18:00:38.126066 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO dbcounter [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Registered counter for database nova_api Aug 08 18:00:38.144713 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_db.sqlalchemy.engines [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:00:38.146288 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_db.sqlalchemy.engines [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:00:38.151324 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writer thread running {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:00:38.152957 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writer thread running {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:00:38.206405 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.context [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),320277b0-4e75-45a4-acb0-6acffeb7474a(cell1) {{(pid=103848) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 18:00:38.208405 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.context [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),320277b0-4e75-45a4-acb0-6acffeb7474a(cell1) {{(pid=103847) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 18:00:38.210349 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:00:38.210779 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:00:38.212293 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_concurrency.lockutils [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:00:38.212398 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:00:38.212799 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_concurrency.lockutils [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:00:38.213056 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:00:38.213496 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:00:38.214366 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_concurrency.lockutils [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:00:38.215089 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_concurrency.lockutils [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:00:38.215471 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:00:38.215563 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_concurrency.lockutils [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:00:38.217449 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO dbcounter [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Registered counter for database nova_cell0 Aug 08 18:00:38.217552 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_concurrency.lockutils [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:00:38.219529 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO dbcounter [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Registered counter for database nova_cell0 Aug 08 18:00:38.222931 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO dbcounter [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Registered counter for database nova_cell1 Aug 08 18:00:38.224913 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO dbcounter [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Registered counter for database nova_cell1 Aug 08 18:00:38.230117 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_db.sqlalchemy.engines [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:00:38.233223 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_db.sqlalchemy.engines [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:00:38.234126 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_db.sqlalchemy.engines [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:00:38.236451 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_db.sqlalchemy.engines [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:00:38.237719 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writer thread running {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:00:38.239400 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writer thread running {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:00:38.375640 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writer thread running {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:00:38.379144 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writer thread running {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:00:38.385561 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO dbcounter [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Registered counter for database nova_cell0 Aug 08 18:00:38.388178 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO dbcounter [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Registered counter for database nova_cell0 Aug 08 18:00:38.392457 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_db.sqlalchemy.engines [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:00:38.395056 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG oslo_db.sqlalchemy.engines [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:00:38.397503 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writer thread running {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:00:38.399414 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writer thread running {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:00:38.810009 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: WARNING keystonemiddleware.auth_token [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 18:00:38.817468 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: WARNING keystonemiddleware.auth_token [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 18:00:38.841463 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: WARNING keystonemiddleware.auth_token [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 18:00:38.849188 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: WARNING keystonemiddleware.auth_token [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 18:00:39.157426 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: WARNING keystonemiddleware.auth_token [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 18:00:39.163284 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: WARNING keystonemiddleware.auth_token [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 18:00:39.168556 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626487c39c0 pid: 103848 (default app) Aug 08 18:00:39.170626 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:00:39.171812 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Aug 08 18:00:39.172226 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Mon Aug 8 18:00:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:00:39.189722 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: WARNING keystonemiddleware.auth_token [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 18:00:39.195672 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: WARNING keystonemiddleware.auth_token [None req-08ac7772-51c5-4068-b1cc-37d050b01600 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 18:00:39.200928 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626487c39c0 pid: 103847 (default app) Aug 08 18:01:57.576251 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:01:57.577433 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Aug 08 18:01:57.578286 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:01:57.590601 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writing DB stats nova_api:SELECT=3 {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:01:57.591485 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writing DB stats nova_cell0:SELECT=3 {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:01:57.592240 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writing DB stats nova_cell1:SELECT=3 {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:01:57.593454 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:01:58.453354 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-887cc989-a2a5-4fd1-a1bd-df733f4d444d admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:01:58.487091 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-887cc989-a2a5-4fd1-a1bd-df733f4d444d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.901669 Aug 08 18:01:58.488073 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Aug 8 18:01:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:00.676896 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:00.678068 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-057424a2-069a-4980-9015-45dfcda91fbd None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 08 18:02:00.678550 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:01.158687 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-e8c1d1e1-207c-4125-9589-80c4db360707 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "disk": 1}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:01.179845 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 18:02:01.179845 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: warnings.warn(msg) Aug 08 18:02:01.279176 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-e8c1d1e1-207c-4125-9589-80c4db360707 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.591507 Aug 08 18:02:01.287622 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:02:01.551181 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-a9a4a9b2-cdb6-4c97-8119-9922f99e4445 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:01.555580 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 18:02:01.555580 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: warnings.warn(msg) Aug 08 18:02:01.558552 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_api:SELECT=3 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:02:01.559660 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_cell1:SELECT=3 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:02:01.560848 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_cell0:SELECT=3 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:02:01.561684 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:02:01.692680 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-a9a4a9b2-cdb6-4c97-8119-9922f99e4445 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.403848 Aug 08 18:02:01.693612 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 18:02:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:03.944743 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-e8c1d1e1-207c-4125-9589-80c4db360707 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:03.946413 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-e8c1d1e1-207c-4125-9589-80c4db360707 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002667 Aug 08 18:02:03.947054 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:04.605872 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-c6207d3f-a3e8-4737-871d-898aa71a7265 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "id": "d1"}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:04.625471 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 18:02:04.625471 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: warnings.warn(msg) Aug 08 18:02:04.722787 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-c6207d3f-a3e8-4737-871d-898aa71a7265 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.769101 Aug 08 18:02:04.723550 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:02:04.735393 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-0367178d-120f-47ae-bf14-e470a21ffd21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:04.738465 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 18:02:04.738465 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: warnings.warn(msg) Aug 08 18:02:04.871728 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-0367178d-120f-47ae-bf14-e470a21ffd21 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139983 Aug 08 18:02:04.872563 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 18:02:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:07.059599 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-c6207d3f-a3e8-4737-871d-898aa71a7265 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:07.060681 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-c6207d3f-a3e8-4737-871d-898aa71a7265 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 08 18:02:07.061085 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:07.455133 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-24c10be3-1723-4d8c-9a06-7fe17a1c92d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "disk": 10, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:07.526041 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-24c10be3-1723-4d8c-9a06-7fe17a1c92d4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459010 Aug 08 18:02:07.526530 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:02:07.538658 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-69965e7f-6685-43ae-8c2f-2ec06f8d4b13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:07.618812 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-69965e7f-6685-43ae-8c2f-2ec06f8d4b13 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083874 Aug 08 18:02:07.619413 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 18:02:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:09.812830 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-24c10be3-1723-4d8c-9a06-7fe17a1c92d4 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:09.813984 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-24c10be3-1723-4d8c-9a06-7fe17a1c92d4 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Aug 08 18:02:09.814462 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:10.243974 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-7fc59b4d-1cf6-4543-abde-40c0afb7031b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:10.359125 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-7fc59b4d-1cf6-4543-abde-40c0afb7031b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538345 Aug 08 18:02:10.359704 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:02:10.372216 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-20439ca4-2b2a-4c78-8cd6-9ec7399326bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:10.471623 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-20439ca4-2b2a-4c78-8cd6-9ec7399326bb admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103569 Aug 08 18:02:10.472215 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 18:02:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:12.668088 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-7fc59b4d-1cf6-4543-abde-40c0afb7031b admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:12.669228 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-7fc59b4d-1cf6-4543-abde-40c0afb7031b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 08 18:02:12.669642 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:13.103723 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-c0f218c5-a7e4-4f87-866a-e4fd35000b0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "vcpus": 4, "disk": 20}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:13.190371 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-c0f218c5-a7e4-4f87-866a-e4fd35000b0d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514530 Aug 08 18:02:13.190929 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:02:13.203560 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-0e19934a-6055-4524-a5d4-64b69944d035 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:13.311419 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-0e19934a-6055-4524-a5d4-64b69944d035 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112045 Aug 08 18:02:13.312125 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Aug 8 18:02:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:15.511787 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-c0f218c5-a7e4-4f87-866a-e4fd35000b0d admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:15.512839 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-c0f218c5-a7e4-4f87-866a-e4fd35000b0d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Aug 08 18:02:15.513242 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:15.959820 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-f18c99b1-2f23-45f3-af70-97f82168d237 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:15.984716 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-f18c99b1-2f23-45f3-af70-97f82168d237 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.464959 Aug 08 18:02:15.985259 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Aug 8 18:02:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:02:18.652374 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-c0f218c5-a7e4-4f87-866a-e4fd35000b0d admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:18.653415 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-c0f218c5-a7e4-4f87-866a-e4fd35000b0d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 08 18:02:18.653816 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:19.133682 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-aab6259d-161a-4a43-b5f9-4f3b9d5f04e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:19.228873 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-aab6259d-161a-4a43-b5f9-4f3b9d5f04e3 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.569067 Aug 08 18:02:19.229607 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:02:19.241730 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-bff35cde-aac5-464b-a128-61854eb61866 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:19.326096 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-bff35cde-aac5-464b-a128-61854eb61866 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087606 Aug 08 18:02:19.326918 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 18:02:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:21.501433 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-aab6259d-161a-4a43-b5f9-4f3b9d5f04e3 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:21.511165 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-aab6259d-161a-4a43-b5f9-4f3b9d5f04e3 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 08 18:02:21.511165 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:21.899802 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-ff9e53bc-42f5-4f6b-b930-03725df4eea9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 20}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:21.971641 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-ff9e53bc-42f5-4f6b-b930-03725df4eea9 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462992 Aug 08 18:02:21.972191 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:02:21.984895 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-56bedf7c-4876-440f-acb8-49bb4c20afcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:22.067300 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-56bedf7c-4876-440f-acb8-49bb4c20afcb admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086186 Aug 08 18:02:22.067841 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 18:02:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:24.238101 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-ff9e53bc-42f5-4f6b-b930-03725df4eea9 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:24.239105 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-ff9e53bc-42f5-4f6b-b930-03725df4eea9 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 08 18:02:24.239506 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:24.599593 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-3813f7a2-cd29-4a96-9b58-6683d49b1d49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:24.696611 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-3813f7a2-cd29-4a96-9b58-6683d49b1d49 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.450866 Aug 08 18:02:24.697093 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:02:24.709321 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-67502a8b-9c0f-44f8-be91-d82d95bb04e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:24.803611 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-67502a8b-9c0f-44f8-be91-d82d95bb04e9 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097759 Aug 08 18:02:24.804279 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 18:02:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:27.046707 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-3813f7a2-cd29-4a96-9b58-6683d49b1d49 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:27.047719 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-3813f7a2-cd29-4a96-9b58-6683d49b1d49 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 08 18:02:27.052995 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:27.486561 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-be87a6a3-505e-4633-9e69-3e315faf5bb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "ram": 8192, "vcpus": 4, "swap": 0, "disk": 80}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:27.586077 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-be87a6a3-505e-4633-9e69-3e315faf5bb0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.531896 Aug 08 18:02:27.593854 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:02:27.598908 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-6d81d1ae-62cd-466e-be08-2342687f648a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:27.695738 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-6d81d1ae-62cd-466e-be08-2342687f648a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100671 Aug 08 18:02:27.696326 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 18:02:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:02:30.003116 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-be87a6a3-505e-4633-9e69-3e315faf5bb0 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:30.004868 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-be87a6a3-505e-4633-9e69-3e315faf5bb0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Aug 08 18:02:30.005512 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:30.445958 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-a525d2f5-d23f-4266-a925-7d41047a8f56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "disk": 160}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:30.529721 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-a525d2f5-d23f-4266-a925-7d41047a8f56 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.518295 Aug 08 18:02:30.530661 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Aug 8 18:02:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:02:30.542136 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-d6774bb1-8388-424d-8e6f-a8d8bf778226 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:30.547728 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:02:30.637840 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-d6774bb1-8388-424d-8e6f-a8d8bf778226 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099382 Aug 08 18:02:30.638620 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Aug 8 18:02:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:02:50.651701 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-a525d2f5-d23f-4266-a925-7d41047a8f56 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:50.652820 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-a525d2f5-d23f-4266-a925-7d41047a8f56 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 08 18:02:50.653220 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:02:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:51.038531 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-6ce1e1cc-6736-4316-94fe-cd6375c74957 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:51.056736 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-6ce1e1cc-6736-4316-94fe-cd6375c74957 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397125 Aug 08 18:02:51.057217 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Aug 8 18:02:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:02:52.110303 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-a525d2f5-d23f-4266-a925-7d41047a8f56 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:52.111304 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-a525d2f5-d23f-4266-a925-7d41047a8f56 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 08 18:02:52.111696 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:02:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:52.615447 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-9bcec30a-4157-471c-863a-25dfce465261 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:52.621040 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.wsgi [None req-9bcec30a-4157-471c-863a-25dfce465261 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-9bcec30a-4157-471c-863a-25dfce465261 admin admin] Request method failure captured: Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Accept: application/json Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Accept-Encoding: gzip, deflate Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Connection: keep-alive Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Content-Length: 0 Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Host: 10.222.0.50 Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Openstack-Api-Version: compute 2.90 Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Openstack-System-Scope: None Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: User-Agent: python-novaclient Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Auth-Token: gAAAAABi8U_MHsZXyHMf5zCYlot_nZ-VX4uTCla0lX0DvbNJ3Bo3vYbD7I6VS53kqnRs9vplx4mCyK_hYHZ0pj8_xAlKcG2dxLEbfpVYEZlGAxqbxUoJbHPwgPltjYN-Q2SknxBuEoJNWNQSrkukQZ5HgHcFyYQZvRcRS6SzGABTiMNjP_b8b3g Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Domain-Id: None Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Domain-Name: None Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Identity-Status: Confirmed Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Is-Admin-Project: True Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Domain-Id: default Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Domain-Name: Default Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Name: admin Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Role: admin,reader,member Aug 08 18:02:52.624265 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Roles: admin,reader,member Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c1d22d0f80a4861a903f2c834f48928", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant: admin Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant-Name: admin Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User: admin Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Domain-Id: default Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Domain-Name: Default Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Id: 2c322d3415e942c2b44d2bbf25f886a1 Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Name: admin Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: method: > Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: exception: Flavor 42 could not be found. Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: action_args: {'id': '42'} Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:02:52.625860 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:52.626729 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.628114 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-9bcec30a-4157-471c-863a-25dfce465261 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:02:52.629426 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-9bcec30a-4157-471c-863a-25dfce465261 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.379635 Aug 08 18:02:52.629426 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Aug 8 18:02:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 18:02:52.635988 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-3b1eb265-b643-41ad-afa0-2e430dac2174 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:52.640045 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:02:52.658779 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-3b1eb265-b643-41ad-afa0-2e430dac2174 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026830 Aug 08 18:02:52.659323 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 18:02:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:02:52.668796 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-d0d4a49d-a09d-4d29-b3a1-6c1cdee2febc admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:52.692187 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-d0d4a49d-a09d-4d29-b3a1-6c1cdee2febc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026904 Aug 08 18:02:52.692756 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 18:02:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:02:52.702467 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-15254f73-6f4b-4a6e-b440-aab656d8f774 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:52.708949 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.wsgi [None req-15254f73-6f4b-4a6e-b440-aab656d8f774 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-15254f73-6f4b-4a6e-b440-aab656d8f774 admin admin] Request method failure captured: Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Accept: application/json Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Accept-Encoding: gzip, deflate Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Connection: keep-alive Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Content-Length: 0 Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Host: 10.222.0.50 Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Openstack-Api-Version: compute 2.90 Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Openstack-System-Scope: None Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: User-Agent: python-novaclient Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Auth-Token: gAAAAABi8U_MHsZXyHMf5zCYlot_nZ-VX4uTCla0lX0DvbNJ3Bo3vYbD7I6VS53kqnRs9vplx4mCyK_hYHZ0pj8_xAlKcG2dxLEbfpVYEZlGAxqbxUoJbHPwgPltjYN-Q2SknxBuEoJNWNQSrkukQZ5HgHcFyYQZvRcRS6SzGABTiMNjP_b8b3g Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Domain-Id: None Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Domain-Name: None Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Identity-Status: Confirmed Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Is-Admin-Project: True Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Domain-Id: default Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Domain-Name: Default Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Name: admin Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Role: admin,reader,member Aug 08 18:02:52.712772 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Roles: admin,reader,member Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c1d22d0f80a4861a903f2c834f48928", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant: admin Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant-Name: admin Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User: admin Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Domain-Id: default Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Domain-Name: Default Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Id: 2c322d3415e942c2b44d2bbf25f886a1 Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Name: admin Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: method: > Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: exception: Flavor 42 could not be found. Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: action_args: {'id': '42'} Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:02:52.721263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:52.722071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:52.723128 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-15254f73-6f4b-4a6e-b440-aab656d8f774 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:02:52.724338 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-15254f73-6f4b-4a6e-b440-aab656d8f774 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015303 Aug 08 18:02:52.724338 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Aug 8 18:02:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 18:02:53.676632 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-d0d4a49d-a09d-4d29-b3a1-6c1cdee2febc admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:53.677656 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-d0d4a49d-a09d-4d29-b3a1-6c1cdee2febc admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 08 18:02:53.678055 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:02:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:54.197707 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-4a9fdbd2-ab25-4296-9def-89fb74845459 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:54.203367 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.wsgi [None req-4a9fdbd2-ab25-4296-9def-89fb74845459 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-4a9fdbd2-ab25-4296-9def-89fb74845459 admin admin] Request method failure captured: Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Accept: application/json Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Accept-Encoding: gzip, deflate Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Connection: keep-alive Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Content-Length: 0 Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Host: 10.222.0.50 Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Openstack-Api-Version: compute 2.90 Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Openstack-System-Scope: None Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: User-Agent: python-novaclient Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Auth-Token: gAAAAABi8U_NNpcBAcQPIRC2_-WCrKdq3VVFooN54u_ZncEXxOrbswXtaGqC215J7uIl-KBUHYDiDIyJOJZvIYS5UC__vG1AKWre8qahs1e5JOjy7qll1MOT_t7JAH2Z12sa6w4kihNyKFfZeRDqH8WcjJ-f1NqzJ8XGmNlPcXh2F37F1JCwq7o Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Domain-Id: None Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Domain-Name: None Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Identity-Status: Confirmed Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Is-Admin-Project: True Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Domain-Id: default Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Domain-Name: Default Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Name: admin Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Role: admin,reader,member Aug 08 18:02:54.204932 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Roles: admin,reader,member Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c1d22d0f80a4861a903f2c834f48928", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant: admin Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant-Name: admin Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User: admin Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Domain-Id: default Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Domain-Name: Default Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Id: 2c322d3415e942c2b44d2bbf25f886a1 Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Name: admin Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: method: > Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: exception: Flavor 84 could not be found. Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: action_args: {'id': '84'} Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:02:54.206470 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:54.207280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.208414 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-4a9fdbd2-ab25-4296-9def-89fb74845459 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:02:54.209463 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-4a9fdbd2-ab25-4296-9def-89fb74845459 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387219 Aug 08 18:02:54.209463 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Aug 8 18:02:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 18:02:54.215939 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-cd78d65b-c598-4d88-87f7-40e15b4686a7 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:54.231179 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-cd78d65b-c598-4d88-87f7-40e15b4686a7 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018774 Aug 08 18:02:54.231709 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 18:02:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:02:54.240872 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-e6935497-a693-4c22-8df6-8a185deded12 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:54.258145 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-e6935497-a693-4c22-8df6-8a185deded12 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020722 Aug 08 18:02:54.258691 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 18:02:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:02:54.267884 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-4f430c36-c743-40cd-acbe-ac3393409bce admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:54.273181 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.wsgi [None req-4f430c36-c743-40cd-acbe-ac3393409bce admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-4f430c36-c743-40cd-acbe-ac3393409bce admin admin] Request method failure captured: Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Accept: application/json Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Accept-Encoding: gzip, deflate Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Connection: keep-alive Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Content-Length: 0 Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Host: 10.222.0.50 Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Openstack-Api-Version: compute 2.90 Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Openstack-System-Scope: None Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: User-Agent: python-novaclient Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Auth-Token: gAAAAABi8U_NNpcBAcQPIRC2_-WCrKdq3VVFooN54u_ZncEXxOrbswXtaGqC215J7uIl-KBUHYDiDIyJOJZvIYS5UC__vG1AKWre8qahs1e5JOjy7qll1MOT_t7JAH2Z12sa6w4kihNyKFfZeRDqH8WcjJ-f1NqzJ8XGmNlPcXh2F37F1JCwq7o Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Domain-Id: None Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Domain-Name: None Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Identity-Status: Confirmed Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Is-Admin-Project: True Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Domain-Id: default Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Domain-Name: Default Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Name: admin Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Role: admin,reader,member Aug 08 18:02:54.274694 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Roles: admin,reader,member Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c1d22d0f80a4861a903f2c834f48928", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant: admin Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant-Name: admin Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User: admin Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Domain-Id: default Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Domain-Name: Default Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Id: 2c322d3415e942c2b44d2bbf25f886a1 Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Name: admin Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: method: > Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: exception: Flavor 84 could not be found. Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: action_args: {'id': '84'} Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:02:54.276277 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:54.277254 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:54.278320 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-4f430c36-c743-40cd-acbe-ac3393409bce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:02:54.279370 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-4f430c36-c743-40cd-acbe-ac3393409bce admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011682 Aug 08 18:02:54.279370 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Aug 8 18:02:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 18:02:55.237958 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-e6935497-a693-4c22-8df6-8a185deded12 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:55.238991 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-e6935497-a693-4c22-8df6-8a185deded12 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 08 18:02:55.239381 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:55.760122 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-80839c48-367e-4610-a291-024169ff4b19 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:55.765839 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.wsgi [None req-80839c48-367e-4610-a291-024169ff4b19 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-80839c48-367e-4610-a291-024169ff4b19 admin admin] Request method failure captured: Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Accept: application/json Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Accept-Encoding: gzip, deflate Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Connection: keep-alive Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Content-Length: 0 Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Host: 10.222.0.50 Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Openstack-Api-Version: compute 2.90 Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Openstack-System-Scope: None Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: User-Agent: python-novaclient Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Auth-Token: gAAAAABi8U_PwbdqlEUVm-SgCMGfU8hxgXU4ioEUD_Dir9X_GqO_fgvXSWK8QlWzcpXw37sHaZekTxqIqq5jpNb82paoihYRBEiQWtNDxZHpfVV8QaFFD0eme2XFTfAovlaMbxCJ0j30m1GxVU19ycLaWzYev8MRZt4UVJ4NQoRLdKhrGAaea1Y Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Domain-Id: None Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Domain-Name: None Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Identity-Status: Confirmed Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Is-Admin-Project: True Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Domain-Id: default Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Domain-Name: Default Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Project-Name: admin Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Role: admin,reader,member Aug 08 18:02:55.767318 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Roles: admin,reader,member Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c1d22d0f80a4861a903f2c834f48928", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant: admin Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-Tenant-Name: admin Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User: admin Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Domain-Id: default Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Domain-Name: Default Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Id: 2c322d3415e942c2b44d2bbf25f886a1 Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: X-User-Name: admin Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: method: > Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: exception: Flavor 451 could not be found. Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: action_args: {'id': '451'} Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:02:55.768902 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:55.769849 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.771158 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-80839c48-367e-4610-a291-024169ff4b19 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:02:55.772387 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-80839c48-367e-4610-a291-024169ff4b19 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390009 Aug 08 18:02:55.772387 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 18:02:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 18:02:55.780097 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-b5816ebe-1924-4428-b152-583ce624fe68 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:55.795477 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-b5816ebe-1924-4428-b152-583ce624fe68 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020748 Aug 08 18:02:55.796014 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 18:02:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:02:55.805440 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:55.820736 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018738 Aug 08 18:02:55.821255 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Aug 8 18:02:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:02:55.830491 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-d6d35104-54bf-443e-8e58-552cc815089d admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:55.835733 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.wsgi [None req-d6d35104-54bf-443e-8e58-552cc815089d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-d6d35104-54bf-443e-8e58-552cc815089d admin admin] Request method failure captured: Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Accept: application/json Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Accept-Encoding: gzip, deflate Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Connection: keep-alive Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Content-Length: 0 Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Host: 10.222.0.50 Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Openstack-Api-Version: compute 2.90 Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Openstack-System-Scope: None Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: User-Agent: python-novaclient Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Auth-Token: gAAAAABi8U_PwbdqlEUVm-SgCMGfU8hxgXU4ioEUD_Dir9X_GqO_fgvXSWK8QlWzcpXw37sHaZekTxqIqq5jpNb82paoihYRBEiQWtNDxZHpfVV8QaFFD0eme2XFTfAovlaMbxCJ0j30m1GxVU19ycLaWzYev8MRZt4UVJ4NQoRLdKhrGAaea1Y Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Domain-Id: None Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Domain-Name: None Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Identity-Status: Confirmed Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Is-Admin-Project: True Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Domain-Id: default Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Domain-Name: Default Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Project-Name: admin Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Role: admin,reader,member Aug 08 18:02:55.837263 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Roles: admin,reader,member Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c1d22d0f80a4861a903f2c834f48928", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c1d22d0f80a4861a903f2c834f48928"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant: admin Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant-Id: 6c1d22d0f80a4861a903f2c834f48928 Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-Tenant-Name: admin Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User: admin Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Domain-Id: default Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Domain-Name: Default Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Id: 2c322d3415e942c2b44d2bbf25f886a1 Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: X-User-Name: admin Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: method: > Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: exception: Flavor 451 could not be found. Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: action_args: {'id': '451'} Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:02:55.838852 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:55.839956 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: ERROR nova.api.openstack.wsgi Aug 08 18:02:55.841180 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-d6d35104-54bf-443e-8e58-552cc815089d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:02:55.842252 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-d6d35104-54bf-443e-8e58-552cc815089d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011871 Aug 08 18:02:55.842252 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 18:02:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 18:02:56.825823 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:56.826836 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 08 18:02:56.827242 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:02:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:57.344579 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-43273b89-8ef1-4a12-b4ca-bd9ee0342507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:57.416041 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-43273b89-8ef1-4a12-b4ca-bd9ee0342507 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.447144 Aug 08 18:02:57.416586 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Aug 8 18:02:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:02:58.376978 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:58.378013 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 08 18:02:58.378416 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:02:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:02:58.896903 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-2eb27524-5f87-4d61-944b-8d97501471dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:02:59.010387 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-2eb27524-5f87-4d61-944b-8d97501471dd admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.496744 Aug 08 18:02:59.010935 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Aug 8 18:02:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:02:59.974444 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:02:59.975453 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 08 18:02:59.975858 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:02:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:03:00.492216 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-e4d3b886-c2a5-40e0-a5ad-5fe993e57d8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:03:00.809558 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-e4d3b886-c2a5-40e0-a5ad-5fe993e57d8e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.696065 Aug 08 18:03:00.810151 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Aug 8 18:03:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:03:01.788347 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:01.788347 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 08 18:03:01.788347 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:03:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:03:02.309668 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-c1c56626-fd95-4bae-81ec-9ef33068d9a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:03:02.408486 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-c1c56626-fd95-4bae-81ec-9ef33068d9a5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.480151 Aug 08 18:03:02.409081 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Aug 8 18:03:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:03:03.373358 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:03.375776 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002907 Aug 08 18:03:03.376179 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:03:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:03:03.910071 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-eada490b-5ce5-425e-89d2-ea916616a005 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:03.930775 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-eada490b-5ce5-425e-89d2-ea916616a005 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410090 Aug 08 18:03:03.931949 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Mon Aug 8 18:03:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:03:55.028334 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:55.029382 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-08015138-7920-42db-93a7-d9d1907475b0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 08 18:03:55.029785 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Mon Aug 8 18:03:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:03:55.040685 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:03:55.412675 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-5553f243-9393-4ff6-8248-62eac9d135a4 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:55.433171 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-5553f243-9393-4ff6-8248-62eac9d135a4 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397493 Aug 08 18:03:55.433715 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Aug 8 18:03:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:03:55.457742 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-18d25468-eccd-4a9d-8ff3-d7e4f6fc7dbb admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:55.461175 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG dbcounter [-] [103847] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:03:55.466074 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-18d25468-eccd-4a9d-8ff3-d7e4f6fc7dbb admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011995 Aug 08 18:03:55.466598 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Mon Aug 8 18:03:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:03:55.477995 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-0d52d045-f97d-4b3f-9876-cb657ad849ba admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:55.485796 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-0d52d045-f97d-4b3f-9876-cb657ad849ba admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011328 Aug 08 18:03:55.486317 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Mon Aug 8 18:03:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:03:55.498198 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:55.505733 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011276 Aug 08 18:03:55.506255 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Mon Aug 8 18:03:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:03:55.517501 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-09a01abc-1cf2-4820-89be-29ccfdf6a879 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:03:55.525736 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-09a01abc-1cf2-4820-89be-29ccfdf6a879 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011791 Aug 08 18:03:55.526245 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Mon Aug 8 18:03:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:06:56.813145 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:06:56.814312 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Aug 08 18:06:56.814712 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:06:56.955322 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_api:SELECT=6 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:06:57.121280 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-e47b859e-554b-496b-82f7-4c211b1db000 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:06:57.123621 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 18:06:57.123621 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: warnings.warn(msg) Aug 08 18:06:57.124778 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-e47b859e-554b-496b-82f7-4c211b1db000 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:06:57.125286 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-e47b859e-554b-496b-82f7-4c211b1db000 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:06:57.125715 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-e47b859e-554b-496b-82f7-4c211b1db000 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:06:57.126934 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-e47b859e-554b-496b-82f7-4c211b1db000 admin admin] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:06:57.127437 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-e47b859e-554b-496b-82f7-4c211b1db000 admin admin] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:06:57.127855 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-e47b859e-554b-496b-82f7-4c211b1db000 admin admin] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:06:57.161503 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-e47b859e-554b-496b-82f7-4c211b1db000 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208263 Aug 08 18:06:57.162067 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 18:06:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:06:57.982977 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:06:57.984052 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 08 18:06:57.984466 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:06:58.175159 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-7215877e-f0b4-410f-b384-176cda7b931c admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:06:58.177690 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 18:06:58.177690 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: warnings.warn(msg) Aug 08 18:06:58.178816 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-7215877e-f0b4-410f-b384-176cda7b931c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:06:58.179289 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-7215877e-f0b4-410f-b384-176cda7b931c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:06:58.179713 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-7215877e-f0b4-410f-b384-176cda7b931c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:06:58.180434 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-7215877e-f0b4-410f-b384-176cda7b931c admin admin] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:06:58.180906 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-7215877e-f0b4-410f-b384-176cda7b931c admin admin] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:06:58.181320 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-7215877e-f0b4-410f-b384-176cda7b931c admin admin] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:06:58.201328 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-7215877e-f0b4-410f-b384-176cda7b931c admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077818 Aug 08 18:06:58.201904 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 18:06:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:07:09.441919 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:07:09.442926 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 08 18:07:09.443323 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:07:09.587103 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_cell0:SELECT=4 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:07:09.587876 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_cell1:SELECT=4 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:07:09.588478 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG dbcounter [-] [103848] Writing DB stats nova_api:SELECT=8 {{(pid=103848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:07:09.636033 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-f99e9a5c-83e6-47ac-bdc0-5ea57d2e9d93 admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:07:09.638413 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 18:07:09.638413 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: warnings.warn(msg) Aug 08 18:07:09.639563 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-f99e9a5c-83e6-47ac-bdc0-5ea57d2e9d93 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:07:09.640070 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-f99e9a5c-83e6-47ac-bdc0-5ea57d2e9d93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:07:09.640495 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-f99e9a5c-83e6-47ac-bdc0-5ea57d2e9d93 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:07:09.641339 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-f99e9a5c-83e6-47ac-bdc0-5ea57d2e9d93 admin admin] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:07:09.642333 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-f99e9a5c-83e6-47ac-bdc0-5ea57d2e9d93 admin admin] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:07:09.642752 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-f99e9a5c-83e6-47ac-bdc0-5ea57d2e9d93 admin admin] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:07:09.668321 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-f99e9a5c-83e6-47ac-bdc0-5ea57d2e9d93 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085534 Aug 08 18:07:09.668842 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 38/74] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 18:07:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:07:10.496052 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: DEBUG nova.api.openstack.wsgi [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] Calling method '>' {{(pid=103847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:07:10.497191 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: INFO nova.api.openstack.requestlog [None req-92240723-f408-4126-b6bc-247ee130d997 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 08 18:07:10.497596 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: [pid: 103847|app: 0|req: 37/75] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Aug 8 18:07:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:07:10.686482 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG nova.api.openstack.wsgi [None req-6330be2f-c2ba-482a-b91c-7f5a1d51a47d admin admin] Calling method '>' {{(pid=103848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:07:10.689379 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 18:07:10.689379 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: warnings.warn(msg) Aug 08 18:07:10.690573 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-6330be2f-c2ba-482a-b91c-7f5a1d51a47d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:07:10.691052 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-6330be2f-c2ba-482a-b91c-7f5a1d51a47d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:07:10.691480 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-6330be2f-c2ba-482a-b91c-7f5a1d51a47d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:07:10.692201 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-6330be2f-c2ba-482a-b91c-7f5a1d51a47d admin admin] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:07:10.692716 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-6330be2f-c2ba-482a-b91c-7f5a1d51a47d admin admin] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:07:10.693138 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: DEBUG oslo_concurrency.lockutils [None req-6330be2f-c2ba-482a-b91c-7f5a1d51a47d admin admin] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:07:10.715390 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: INFO nova.api.openstack.requestlog [None req-6330be2f-c2ba-482a-b91c-7f5a1d51a47d admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079397 Aug 08 18:07:10.715890 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: [pid: 103848|app: 0|req: 39/76] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Aug 8 18:07:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:08:06.204365 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: Mon Aug 8 18:08:06 2022 - graceful shutdown triggered... Aug 08 18:08:06.204531 dv-cinder-852364-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 18:08:06.205326 dv-cinder-852364-1-iscsi devstack@n-api.service[103848]: Gracefully killing worker 2 (pid: 103848)... Aug 08 18:08:06.205697 dv-cinder-852364-1-iscsi devstack@n-api.service[103847]: Gracefully killing worker 1 (pid: 103847)... Aug 08 18:08:07.206150 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: worker 1 buried after 1 seconds Aug 08 18:08:07.206150 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: worker 2 buried after 1 seconds Aug 08 18:08:07.206150 dv-cinder-852364-1-iscsi devstack@n-api.service[103846]: goodbye to uWSGI. Aug 08 18:08:07.207729 dv-cinder-852364-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 18:08:07.208290 dv-cinder-852364-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 18:08:07.211248 dv-cinder-852364-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 18:08:07.220349 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 18:08:07.222977 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 18:08:07 2022] *** Aug 08 18:08:07.223141 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 18:08:07.223277 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 18:08:07.223392 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: nodename: dv-cinder-852364-1-iscsi Aug 08 18:08:07.223502 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: machine: x86_64 Aug 08 18:08:07.223613 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: clock source: unix Aug 08 18:08:07.223718 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: pcre jit disabled Aug 08 18:08:07.223814 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: detected number of CPU cores: 4 Aug 08 18:08:07.223919 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: current working directory: / Aug 08 18:08:07.224136 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: detected binary path: /usr/bin/uwsgi-core Aug 08 18:08:07.224251 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: your processes number limit is 47680 Aug 08 18:08:07.224347 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: your memory page size is 4096 bytes Aug 08 18:08:07.224459 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: detected max file descriptor number: 2048 Aug 08 18:08:07.224459 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: lock engine: pthread robust mutexes Aug 08 18:08:07.224714 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: thunder lock: enabled Aug 08 18:08:07.224853 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 18:08:07.224942 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: Python main interpreter initialized at 0x5641835509c0 Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: python threads support enabled Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: your server socket listen backlog is limited to 100 connections Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: your mercy for graceful operations on workers is 90 seconds Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: *** Operational MODE: preforking *** Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: *** uWSGI is running in multiple interpreter mode *** Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: spawned uWSGI master process (pid: 118359) Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: spawned uWSGI worker 1 (pid: 118381, cores: 1) Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: spawned uWSGI worker 2 (pid: 118382, cores: 1) Aug 08 18:08:07.273932 dv-cinder-852364-1-iscsi devstack@n-api.service[118359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 18:08:07.271547 dv-cinder-852364-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 18:08:07.933459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 18:08:07.939222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 18:08:09.106624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 18:08:09.106624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: from cryptography.utils import int_from_bytes Aug 08 18:08:09.107386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 18:08:09.107386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: from cryptography.utils import int_from_bytes Aug 08 18:08:09.108454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 18:08:09.108454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: from cryptography.utils import int_from_bytes Aug 08 18:08:09.108928 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 18:08:09.108928 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: from cryptography.utils import int_from_bytes Aug 08 18:08:11.439573 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 18:08:11.440102 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 18:08:11.440365 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 18:08:11.440767 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 18:08:11.441026 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 18:08:11.441415 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.441755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.442060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.442377 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.442709 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.443020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.443340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.443453 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 18:08:11.443820 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.443901 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 18:08:11.443973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.444223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.444372 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 18:08:11.444557 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.444672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 18:08:11.444882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 18:08:11.444993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-1-iscsi {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.445201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.445311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.445510 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.445615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.445817 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.445926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.446133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.446241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.446438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.446547 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.446757 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.446855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.447060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.447153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.447442 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.447554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.447775 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.447974 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.448091 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.448284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.448392 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.448620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.448745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-1-iscsi {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.448968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.449080 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.449283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.449427 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.449592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.449693 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.449909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.450014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.450469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.450579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.450793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.450894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.451131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.451752 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.452093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-1-iscsi {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.452237 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.452410 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.452537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.452753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.452862 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.453069 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.453161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.453419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.453524 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.453736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.453836 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.454049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.454142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.454370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.454470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.454682 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.454828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.454987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.455089 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.455308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.455417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.455631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.455732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-1-iscsi {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.455951 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.456054 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.456270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.456370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.456636 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.456744 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.456963 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.457070 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.457274 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.457366 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.457592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.457692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.457899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.458003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.458201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.458294 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.458452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.458550 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.458763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.458892 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.459083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.459220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.459407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.459557 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.459727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.459852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.460000 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.460163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.460296 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.460474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.460640 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.460810 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.460913 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.461132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.461227 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.461436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.461536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.461742 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.461846 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.461993 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.462099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.462304 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.462407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.462627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.462718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.462932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.463032 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.463238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.463343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.463500 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.463592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.463753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.463975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.464085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.464183 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.464385 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.464640 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.464774 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.464911 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.465035 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.465191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.465319 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.465456 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.465616 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.465748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.465926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.466086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.466234 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.466405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.466534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.466754 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.466884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.467078 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.467206 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.467400 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.467521 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.467707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.467834 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.468011 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.468138 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.468317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.468438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.468659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.468788 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.468998 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.469118 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.469304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.469741 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.469871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470001 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470364 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470482 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.470956 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.471093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.471212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.471352 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.471489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.471627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.471767 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.471898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.472082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.472183 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.472419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.472626 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.472753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.472858 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.473007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.473111 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.473311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.473414 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.473621 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.473770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.473943 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.474036 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.474253 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.474356 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.474562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.474666 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.474870 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.474970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.475174 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.475279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.475474 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.475566 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.475778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.475950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.476070 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.476156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.476379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.476480 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.476711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.476812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.477016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.477116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.477326 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.477457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.477633 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.477730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.477937 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.478085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.478254 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.478358 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.478559 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.478660 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.478869 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.478961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.479173 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.479271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.479470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.479780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.479887 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.480052 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.480140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.480224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.480369 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.480469 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.480697 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.480801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.481000 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.481094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.481302 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.481395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.481605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.481708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.481906 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.482054 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.482205 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.482299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.482571 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.482672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.482871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.482976 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.483187 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.483280 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.483510 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.483613 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.483819 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.483911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.484122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.484215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.484429 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.484628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.484762 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.484863 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.485071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.485178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.485380 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.485483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.485686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.485789 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.485992 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.486098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.486298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.486399 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.486601 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.486702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.486921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.487027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.487245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.487339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.487556 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.487649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.487866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.487967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.488177 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.488279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.488499 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 18:08:11.488610 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.488841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.488937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.489159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.489252 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.489477 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.489571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.489813 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.489932 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.490131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.490261 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.490450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.490550 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.490770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.490868 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.491083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.491218 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.491400 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.491535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.491750 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.491878 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.492048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.492200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.492361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.492465 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.492702 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.492797 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.493027 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.493122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.493350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.493443 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.493672 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.493765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.493990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.494090 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.494301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.494394 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.494611 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.494705 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.494919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.495018 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.495239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.495337 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.495567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.495659 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.495878 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.495979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.496193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.496298 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.496517 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.496623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.496835 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.496928 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.497144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.497250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.497454 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.497554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.497763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.497863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.498632 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.498742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.498947 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.499047 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.499264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.499357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.499575 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.499676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.499932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.500042 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.500214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.500317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.500533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.500686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.500850 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.500971 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.501162 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.501324 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.501478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.501604 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.501782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.501909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.502092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.502212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.502396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.502523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.502715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.502834 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.503038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.503162 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.503345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.503464 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.503662 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.503778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.503974 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.504098 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.505271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.505452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.505551 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.505651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.505738 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.505839 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.505925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506292 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506389 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506557 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506732 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.506815 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.507010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.507106 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.507192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.507340 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.507441 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.507651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.507753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.507965 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.508065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.508278 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.508372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.509440 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.509626 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.509755 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.509879 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510459 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510552 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510796 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.510986 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511078 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511162 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511246 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511441 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511702 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511785 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.511934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.512114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.512247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.512431 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.512583 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.512763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.512899 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.513074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.513214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.513378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.513542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.514388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.514867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.515309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.515411 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.515652 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.515746 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.515999 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.516090 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.516313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.516414 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.516648 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.516760 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.516959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.517060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.517285 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.517386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.517599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.517691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.517907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.518017 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.518212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.518314 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.518519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.518749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.518853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.518946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.519126 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.519219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.519442 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.519535 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.519754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.519861 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.520082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.520309 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.520408 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.520522 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.520703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.520797 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.521015 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.521108 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.521344 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.521436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.521660 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.521757 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.521970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.522070 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.522275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.522374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.522586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.522687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.522896 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.522987 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.523216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.523308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.523529 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.523638 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.523854 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.523947 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.524169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.524275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.524489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.524770 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.524902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.525028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.525150 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.525252 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.525458 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.525790 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.525941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.526094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.526295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.526401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.526618 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.526718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.526944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.527037 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.527259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.527366 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.527577 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.527670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.527890 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.527981 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.528206 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.528310 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.528566 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.528677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.528857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.528959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.529200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.529298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.529530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.529624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.529856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.529949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.530168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.530277 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.530495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.530608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.530807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.530906 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.531249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.531428 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.531587 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.531753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.531921 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.532155 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.532480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.532823 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.533023 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.533152 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.533379 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.533486 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.533700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.533800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.534018 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.534111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.534346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.534447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.534661 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.534801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.534975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.535089 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.535288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.535399 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.535598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.535700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.535904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.536008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.536215 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.536317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.536551 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.536661 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.536866 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.536959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.537176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.537270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.537484 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.537588 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.537801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.537904 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.538112 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.538215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.538420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.538576 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.538731 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.538824 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.539043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.539129 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.539359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.539447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.539674 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.539757 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.539989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.540084 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.540298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.540386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.540644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.540751 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.540952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.541034 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.541260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.541349 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.541568 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.541664 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.541873 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.541954 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.542180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.542269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.542486 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.542578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.542918 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.543014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.543130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.543212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.543434 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.543530 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.543741 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.543834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.544059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.544147 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.544372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.544468 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.544703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.544799 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.545039 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.545130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.545349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.545440 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.545678 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.545765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.545993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.546080 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.546299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.546381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.546614 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.546702 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.546924 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.547022 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.547235 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.547323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.547544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.547624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.547853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.548007 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.548165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.548278 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.548474 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.548586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.548816 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.548923 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.549123 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.549216 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.549432 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.549533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.549747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.549865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.550060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.550339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.550437 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.550686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.550806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.550999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.551113 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.551311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.551489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.551653 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.551814 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.551958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.552048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.552215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.552316 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.552560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.552673 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.552970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.553130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.553281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.553477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.553594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.553802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.553931 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.554130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.554274 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.554455 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.554589 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.554780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.554885 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.555090 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.555192 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.555394 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.555573 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.555728 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.555898 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.555995 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.556095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.556297 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.556476 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.556661 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.556809 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.556960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.557108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.557285 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.557440 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.557599 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.557769 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.557866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.557961 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.558179 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.558343 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.558512 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.558609 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.558785 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.558902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.559091 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.559193 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.559391 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.559493 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.559695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.559797 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.560011 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.560104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.560319 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.560414 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.561214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.561311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.561544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.561657 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.561876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.561970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.562180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.562282 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.562485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.562586 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.562794 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.562895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.563099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.563190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.563404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.563513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.563709 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.563812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.564017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.564111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.564326 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.564427 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.564652 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.564759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.564963 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.565058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.565272 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.565419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.565582 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.565708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.565889 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.566025 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.566192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.566296 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.566498 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.566591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.566801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.566895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.567116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.567217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.567423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.567523 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.567723 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.567889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.568023 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.568118 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.568321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.568414 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.568651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.568762 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.568955 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.569048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.569263 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.569355 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.569563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.569669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.569879 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.569978 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.570181 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.570274 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.570486 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.570664 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.570792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.570891 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.571101 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.571241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.571404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.571487 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.571707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.571799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.572018 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.572107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.572322 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.572415 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.572650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.572746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.572956 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.573058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.573263 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.573356 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.573563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.573655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.573865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.573959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.574171 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.574273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.574476 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.574567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.574794 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.574959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.575099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.575459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.575669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.575798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.575971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.576094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.576853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.576953 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.577165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.577258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.577475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.577579 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.577789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.577882 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.578114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.578204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.578417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.578518 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.578720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.578820 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.579023 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.579116 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.579328 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.579421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.579637 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.579784 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.579938 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.580038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.580240 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.580334 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.580563 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.580670 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.580876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.580977 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.581182 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.581313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.581491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.581592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.581799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.581915 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.582127 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.582221 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.582450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.582582 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.582742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.582883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.583050 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.583170 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.583356 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.583483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.583663 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.583792 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.583980 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.584100 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.584289 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.584410 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.584623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.584757 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.584918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.585048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.585222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.585343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.585544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.585689 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.585855 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.585977 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.586260 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.586397 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.586518 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.586782 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.587097 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.587418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.587546 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.587727 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.587869 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.588034 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.588209 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.588360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.588550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.588876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.589199 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.589516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.589646 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.589834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.589932 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.590172 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.590332 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.590492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.590595 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.590811 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.590911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.591130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.591236 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.591448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.591548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.591802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.591920 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.592115 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.592219 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.592429 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.592544 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.592790 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.592893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.593102 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.593196 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.593420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.593511 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.593733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.593824 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.594042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.594135 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.594353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.594448 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.594660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.594753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.594974 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.595075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.595281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.595374 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.595594 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.595721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.595929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.596037 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.596247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.596374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.596752 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.596872 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.596949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.597021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.597194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.597294 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.597510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.597616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.597821 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.597914 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.598126 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.598260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.598547 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.598651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.598862 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.598955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.599175 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.599268 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.599488 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.599589 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.599793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.599885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.600099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.600193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.600415 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.600537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.600748 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.600852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.601076 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.601169 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.601383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.601486 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.601691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.601787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.602015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.602116 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.602321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.602426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.602643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.602740 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.602971 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.603078 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.603299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.603401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.603610 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.603704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.603927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.604061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.604236 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.604372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.604602 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.604736 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.604917 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.605061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.605244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.605385 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.605681 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.605795 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.605980 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.606158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.606293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.606395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.606600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.606972 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.607131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.607230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.607822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.607920 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.608067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.608171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.608384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.608478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.608727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.608829 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.609057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.609153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.609380 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.609523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.609697 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.609826 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.610021 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.610149 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.610349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.610453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.610665 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.610766 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.610983 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.611077 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.611293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.611400 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.611621 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.611723 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.611948 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.612078 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.612266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.612398 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.612606 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.612745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.612920 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.613049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.613229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.613351 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.613568 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.613703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.613876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.613996 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.614191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.614319 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.614504 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.614633 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.614813 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.614932 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.615119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.615245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.615550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.615697 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.615857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.615978 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.616098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.616209 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.616330 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.616443 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.616678 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.616810 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.617193 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.617321 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.617449 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.617570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.617683 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.617811 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.617924 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.618044 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.618209 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.618339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.618514 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.618635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.618817 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.618938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.619120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.619249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.619464 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.619586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.619772 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.619906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.620092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.620213 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.620423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.620580 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.620783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.620888 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.621097 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.621179 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.621407 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.621496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.621773 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.621877 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.622042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.622132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.622361 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.622442 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.622683 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.622779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.623065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.623896 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.624254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.625341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.625341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.625341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.625960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.626119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.626270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.626437 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.626612 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.626772 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.626924 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.627324 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.627487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.627647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.627811 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.627972 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.628132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.628283 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.628433 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.628607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.628779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.628944 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.629105 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.629257 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.629416 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.629577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.629730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.629889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.630042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.630200 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.630362 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.630600 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.630778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.631032 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.631210 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.631362 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.631522 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.631688 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.631869 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.632102 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.632269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.632422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.632622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.632788 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.632942 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.633100 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.633253 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.633415 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.633576 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.633728 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.633886 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.634045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.634207 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.634359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.634524 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.634676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.634827 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.634985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.635137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.635299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.635464 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.635624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.635793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.636051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.636219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.636380 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.636569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.636736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.636888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.637050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.637050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.637573 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.637745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.637907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.637907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.638197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.638357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.638519 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.639233 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.639389 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.639549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.639710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.639870 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.640032 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.640185 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.640357 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.640569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.640741 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.640909 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.641161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.641161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.641457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.641620 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.641781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.641943 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.642115 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.642339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.642515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.642670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.642831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.642994 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.643147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.643306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.643459 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.643612 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.643779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.643940 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.644101 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.644260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.644423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.644601 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.644771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.644924 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.645077 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.645236 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.645396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.645562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.645724 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.645876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.646140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.646318 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.646478 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.646641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.646802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.646955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.647121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.647281 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.647653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.647653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.647968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.648120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.648279 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.648432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.648664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.648827 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.648982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.648982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.649287 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.649439 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.649605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.649758 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.649919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.649919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.650208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.650376 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.650549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.650702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.650853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.650853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.651168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.651418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.651576 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.651576 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.651874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.651874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.652180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.652361 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.652679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.652679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.652996 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.653157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.653309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.653470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.653622 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.653781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.653933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.654086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.654293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.654967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.655132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.655303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.655455 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.655614 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.655776 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.655996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.656266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.656424 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.656618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.656773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.656938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.657091 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.657244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.657395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.657584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.657584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.658095 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.658248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.658401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.658552 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.658713 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.658876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.659029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.659189 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.659342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.659500 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.659676 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.659676 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.659988 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.659988 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.660290 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.660290 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.660609 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.660787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.660940 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.661099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.661260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.661432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.661673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.661860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.662012 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.662171 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.662330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.662484 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.662797 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.662957 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.663125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.663286 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.663439 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.663592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.663753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.663943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.664117 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.664270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.664421 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.664614 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.664787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.664948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.665099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.665257 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.665424 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.665587 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.665755 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.665915 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.666075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.666355 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.666512 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.666674 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.666841 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.667001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.667154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.667314 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.667466 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.667627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.667992 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.668151 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.668151 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.668449 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.668637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.668806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.668960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.669119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.669279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.669431 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.669590 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.669590 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.669590 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.669590 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.670215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.670215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.670215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.670215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.670833 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.670993 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.671146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.671305 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.671466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.671466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.671959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.672132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.672297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.672450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.672640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.672893 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.673052 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.673052 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.673340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.673490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.673651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.673804 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.673956 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.674108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.674267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.674267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.674565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.674769 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.674940 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.675106 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.675267 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.675434 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.675586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.675745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.675896 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.676054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.676207 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.676484 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.676711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.676872 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.677035 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.677190 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.677341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.677502 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.677655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.677805 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.678170 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.678329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.678496 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.678657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.678817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.678977 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.679128 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.679301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.679465 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.679626 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.679778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.679937 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.680089 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.680245 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.680414 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.680598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.680771 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.680932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.681093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.681271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.681434 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.681593 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.681745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.682005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.682173 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.682336 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.682489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.682641 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.682791 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.683028 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.683194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.683362 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.683539 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.683700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.683853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.684004 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.684162 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.684324 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.684478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.684684 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.684848 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.685007 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.685170 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.685329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.685528 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.685685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.685837 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.685988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.686150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.686316 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.686584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.686743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.686895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.687063 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.687224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.687384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.687549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.687712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.687866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.688046 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.688389 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.688578 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.688746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.688899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.689050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.689216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.689368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.689520 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.689679 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.689876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.690153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.690335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.690498 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.690650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.690810 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.690964 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.690964 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.691576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.691729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.691890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.692148 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.692318 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.692488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.692666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.692817 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.692968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.693207 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.693364 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.693530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.693693 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.693845 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.693997 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.694155 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.694388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.694562 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.694715 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.694866 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.695027 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.695179 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.695339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.695491 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.695641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.695841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.696005 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.696159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.696323 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.696476 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.696796 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.696961 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.697124 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.697276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.697441 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.697603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.697764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.697916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.698082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.698375 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.698606 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.698769 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.698922 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.699093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.699246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.699407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.699559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.699718 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.699878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.700038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.700542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.700717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.700878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.701030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.701690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.701854 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.702006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.702184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.702434 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.702593 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.702745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.702896 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.703056 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.703234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.703467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.703634 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.703786 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.703938 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.704110 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.704263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.704415 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.704638 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.704798 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.704958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.704958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.705264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.705415 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.705566 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.705724 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.705875 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.706036 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.706199 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.706351 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.706510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.706773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.706943 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.707107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.707266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.707426 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.707580 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.707731 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.707894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.707894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.708195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.708355 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.708629 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.708629 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.709029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.709029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.709335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.709335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.709624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.709786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.709946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.710109 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.710281 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.710443 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.710694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.710960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.711137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.711291 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.711444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.711596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.711748 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.711911 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.712065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.712226 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.712391 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.712776 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.712955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.713111 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.713264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.713452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.713728 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.713899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.714063 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.714224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.714378 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.714531 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.714691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.714859 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.715025 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.715187 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.715341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.715494 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.715655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.715822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.715991 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.716144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.716307 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.716470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.716674 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.717588 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.717768 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.717922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 18:08:11.718085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.718085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.718085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.718085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.718085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.718085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 18:08:11.718085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 18:08:11.863335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO dbcounter [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Registered counter for database nova_api Aug 08 18:08:11.865634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO dbcounter [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Registered counter for database nova_api Aug 08 18:08:11.884055 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_db.sqlalchemy.engines [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:08:11.885779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_db.sqlalchemy.engines [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:08:11.890935 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writer thread running {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:08:11.892322 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writer thread running {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:08:11.947915 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.context [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),320277b0-4e75-45a4-acb0-6acffeb7474a(cell1) {{(pid=118382) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 18:08:11.949338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.context [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),320277b0-4e75-45a4-acb0-6acffeb7474a(cell1) {{(pid=118381) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 18:08:11.952172 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:08:11.952687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:08:11.953700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:08:11.954176 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:08:11.954293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:08:11.954979 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:08:11.955451 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:08:11.955811 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:08:11.956569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:08:11.957018 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:08:11.957495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:08:11.959017 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:08:11.959545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO dbcounter [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Registered counter for database nova_cell0 Aug 08 18:08:11.961089 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO dbcounter [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Registered counter for database nova_cell0 Aug 08 18:08:11.963570 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO dbcounter [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Registered counter for database nova_cell1 Aug 08 18:08:11.965258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO dbcounter [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Registered counter for database nova_cell1 Aug 08 18:08:11.971251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_db.sqlalchemy.engines [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:08:11.973975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_db.sqlalchemy.engines [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:08:11.975137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_db.sqlalchemy.engines [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:08:11.976883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writer thread running {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:08:11.977226 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_db.sqlalchemy.engines [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:08:11.983484 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writer thread running {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:08:11.986109 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writer thread running {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:08:12.118513 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writer thread running {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:08:12.127315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO dbcounter [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Registered counter for database nova_cell0 Aug 08 18:08:12.130066 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO dbcounter [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Registered counter for database nova_cell0 Aug 08 18:08:12.134381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_db.sqlalchemy.engines [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:08:12.136353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_db.sqlalchemy.engines [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 18:08:12.139217 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writer thread running {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:08:12.140800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writer thread running {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 18:08:12.455619 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: WARNING keystonemiddleware.auth_token [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 18:08:12.458063 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: WARNING keystonemiddleware.auth_token [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 18:08:12.462825 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: WARNING keystonemiddleware.auth_token [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 18:08:12.465301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: WARNING keystonemiddleware.auth_token [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 18:08:12.808721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: WARNING keystonemiddleware.auth_token [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 18:08:12.813053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: WARNING keystonemiddleware.auth_token [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 18:08:12.815224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: WARNING keystonemiddleware.auth_token [None req-0eeb164d-3178-4fe9-888e-fed4d7d712cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 18:08:12.818961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: WARNING keystonemiddleware.auth_token [None req-4d6f8cfb-7867-450a-ab3e-8f3e5eb5d6f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 18:08:12.821535 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5641835509c0 pid: 118382 (default app) Aug 08 18:08:12.825805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5641835509c0 pid: 118381 (default app) Aug 08 18:08:49.332534 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:08:49.334066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:08:49.334725 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:08:49.335608 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:08:50.798298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:08:50.800349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:08:50.801607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:08:50.802692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:08:51.166626 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c2a7322d-9ab9-4f84-b526-bde9b4dcc284 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Action: 'create', calling method: .version_select at 0x7f21aef0bdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-351908460"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:08:51.644251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b5fee23c-76c4-40de-83ff-f09b7f56c351 tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Action: 'create', calling method: .version_select at 0x7f21aee47040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1414229677", "metadata": {"Type": "work"}}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:08:53.862971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c2a7322d-9ab9-4f84-b526-bde9b4dcc284 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.543306 Aug 08 18:08:53.865151 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1155 bytes} [Mon Aug 8 18:08:49 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4547 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 18:08:53.881172 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b94747ee-5182-4e68-acbc-a05ecb674686 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed87c10>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:53.949002 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b5fee23c-76c4-40de-83ff-f09b7f56c351 tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.167471 Aug 08 18:08:53.950950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 1/2] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Aug 8 18:08:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3171 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 18:08:53.973780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d0941e7b-ec15-4653-bd69-244123c2476b tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aee47d30>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:54.030272 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b94747ee-5182-4e68-acbc-a05ecb674686 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 200 len: 344 microversion: 2.1 time: 0.154634 Aug 08 18:08:54.036419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:08:53 2022] GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:08:54.117294 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d0941e7b-ec15-4653-bd69-244123c2476b tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 200 len: 353 microversion: 2.1 time: 0.145848 Aug 08 18:08:54.117294 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:08:53 2022] GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:55.047851 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6f4ca61d-7752-429b-afdd-3a8e2e556ca4 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed9b310>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:55.124388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d162462f-bea5-4f43-b308-856ec1e942a7 tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aee47f70>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:55.150601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6f4ca61d-7752-429b-afdd-3a8e2e556ca4 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 200 len: 345 microversion: 2.1 time: 0.108587 Aug 08 18:08:55.159760 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 3/5] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:08:55 2022] GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:55.172600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4a85a5b9-cf4a-4c49-9bca-022a2e5bfb1d tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Action: 'create', calling method: .version_select at 0x7f21aed9b940>, body: {"snapshot": {"volume_id": "1b66e7ea-e862-4eb9-9052-60f77a81977d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-981307278"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:08:55.222975 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d162462f-bea5-4f43-b308-856ec1e942a7 tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 200 len: 354 microversion: 2.1 time: 0.102195 Aug 08 18:08:55.230720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 3/6] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:08:55 2022] GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:55.235884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d4d3a96f-7a5c-47be-a3f9-d70ad086c426 tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aed9f3a0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:56.083235 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4a85a5b9-cf4a-4c49-9bca-022a2e5bfb1d tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.921580 Aug 08 18:08:56.096561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 4/7] 10.222.0.50 () {60 vars in 1162 bytes} [Mon Aug 8 18:08:55 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:56.107312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-91ed3737-36a9-4b0d-9af5-55028bcb1cd3 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed9bc10>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:56.197040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d4d3a96f-7a5c-47be-a3f9-d70ad086c426 tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 200 len: 354 microversion: 2.1 time: 0.964793 Aug 08 18:08:56.198636 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:08:55 2022] GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 354 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:08:56.220310 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6d6eda8b-08c8-480e-8438-fb0c0bbbbfdf tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aed9fa60>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:56.262354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-91ed3737-36a9-4b0d-9af5-55028bcb1cd3 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a" status: 200 len: 286 microversion: 2.1 time: 0.163755 Aug 08 18:08:56.263163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 5/9] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 18:08:56 2022] GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a => generated 286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:56.277018 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-384daa35-1f69-40b1-9db7-47cb74aa8258 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed9b4c0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:56.625584 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-384daa35-1f69-40b1-9db7-47cb74aa8258 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.353784 Aug 08 18:08:56.629139 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6d6eda8b-08c8-480e-8438-fb0c0bbbbfdf tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 202 len: 0 microversion: 2.1 time: 0.413525 Aug 08 18:08:56.629855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 5/10] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:08:56 2022] DELETE /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:08:56.635279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 6/11] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Aug 8 18:08:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:56.649524 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-35b89c8a-54c3-4d47-8e95-fbb3c582af97 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed9f5e0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:56.652244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8bc8ce62-f36a-4d1d-9497-fd3b0dc892eb tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aed9fca0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:56.773921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8bc8ce62-f36a-4d1d-9497-fd3b0dc892eb tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 200 len: 353 microversion: 2.1 time: 0.138646 Aug 08 18:08:56.781948 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:08:56 2022] GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:56.842749 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-35b89c8a-54c3-4d47-8e95-fbb3c582af97 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a" status: 200 len: 286 microversion: 2.1 time: 0.196476 Aug 08 18:08:56.842749 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 18:08:56 2022] GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a => generated 286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:57.789634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-eb080bbb-e881-4475-8f18-d79801c007fe tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aed9f430>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:57.853793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bdd99de2-a850-4f9e-8bdd-bfda38e58cd9 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed87c10>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:57.932704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bdd99de2-a850-4f9e-8bdd-bfda38e58cd9 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a" status: 200 len: 286 microversion: 2.1 time: 0.082769 Aug 08 18:08:57.933711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 8/14] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 18:08:57 2022] GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:08:57.951185 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-eb080bbb-e881-4475-8f18-d79801c007fe tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 200 len: 353 microversion: 2.1 time: 0.166158 Aug 08 18:08:57.952613 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 7/15] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:08:57 2022] GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:58.946417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3922b07b-2de3-4597-92d7-40bc32d73ac3 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed9b310>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:58.966369 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7683cc5a-37e4-4567-b879-ee7155e5102d tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aee470d0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:08:59.018503 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3922b07b-2de3-4597-92d7-40bc32d73ac3 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a" status: 200 len: 286 microversion: 2.1 time: 0.075986 Aug 08 18:08:59.023527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 9/16] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 18:08:58 2022] GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:08:59.134122 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7683cc5a-37e4-4567-b879-ee7155e5102d tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 200 len: 353 microversion: 2.1 time: 0.172293 Aug 08 18:08:59.135533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 8/17] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:08:58 2022] GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:00.031265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d05521bd-cbb3-4470-a332-88611f49d456 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed9b8b0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:00.109456 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d05521bd-cbb3-4470-a332-88611f49d456 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a" status: 200 len: 287 microversion: 2.1 time: 0.082040 Aug 08 18:09:00.116041 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 10/18] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 18:09:00 2022] GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:00.130773 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8369ec66-d94c-4b86-992b-edf1d8ae938a tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aee47f70>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:00.151249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2feee45d-c09c-438e-8a0d-e7a34449b446 tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aed9f8b0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:00.309268 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2feee45d-c09c-438e-8a0d-e7a34449b446 tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 200 len: 353 microversion: 2.1 time: 0.164383 Aug 08 18:09:00.310119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 11/19] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:09:00 2022] GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:09:00.358881 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8369ec66-d94c-4b86-992b-edf1d8ae938a tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a" status: 202 len: 0 microversion: 2.1 time: 0.241182 Aug 08 18:09:00.359864 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 9/20] 10.222.0.50 () {58 vars in 1254 bytes} [Mon Aug 8 18:09:00 2022] DELETE /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:09:00.368061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bc2f7a90-c368-4172-8f5a-ca656ee927c2 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed9baf0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:00.458514 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bc2f7a90-c368-4172-8f5a-ca656ee927c2 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a" status: 200 len: 286 microversion: 2.1 time: 0.089810 Aug 08 18:09:00.459831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 12/21] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 18:09:00 2022] GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:00.827490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-823168362", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "networks": [{"uuid": "cc15dbf6-16b8-4e1d-bd36-aa7c7540dba5"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:01.084298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] validate_networks() for [('cc15dbf6-16b8-4e1d-bd36-aa7c7540dba5', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:09:01.325923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-021554c3-a763-4533-a5bc-9cf4118ed02c tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Calling method '.version_select at 0x7f21aed9b280>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:01.376414 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-021554c3-a763-4533-a5bc-9cf4118ed02c tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] HTTP exception thrown: Volume c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 could not be found. Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-021554c3-a763-4533-a5bc-9cf4118ed02c tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Request method failure captured: Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 HTTP/1.1 Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VEyZCiGjtnjqST6XALDfcL8fRa96QHV7zXKUrSVyCiJD8wbYhkyZDCst0ZDqWlYeApSlUqKRDniOBVzZF1AJwDLgHdqmJWjm6HPkYD_NJo00-PBCD7NyZvfeITXMQgP47zq7y3-pPS0wy8BrLP-GW2qMFWD0joYv-Nkc8z_BgQjAkU Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: e023a8ae7a5340f2b652682525ac8a30 Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesGetTestJSON-1331547252 Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:09:01.383761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e023a8ae7a5340f2b652682525ac8a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e023a8ae7a5340f2b652682525ac8a30", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e023a8ae7a5340f2b652682525ac8a30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e023a8ae7a5340f2b652682525ac8a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesGetTestJSON-1331547252 Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: e023a8ae7a5340f2b652682525ac8a30 Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesGetTestJSON-1331547252 Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesGetTestJSON-1331547252-project Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 491f22a4783f48d298a2507a0b10ddbd Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesGetTestJSON-1331547252-project Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Volume c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 could not be found. Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'c0a1a74d-910c-45ef-b6a4-5d811f4e13b3'} Aug 08 18:09:01.385058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 could not be found. (HTTP 404) (Request-ID: req-f9b9b1a2-60b3-4d59-8516-1cccd573c977) Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:01.385779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:09:01.387301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 could not be found. Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 18:09:01.388248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 could not be found. Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 could not be found. Aug 08 18:09:01.390788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.393470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-021554c3-a763-4533-a5bc-9cf4118ed02c tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] Returning 404 to user: Volume c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:09:01.395201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-021554c3-a763-4533-a5bc-9cf4118ed02c tempest-VolumesGetTestJSON-1331547252 tempest-VolumesGetTestJSON-1331547252-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3" status: 404 len: 109 microversion: 2.1 time: 0.075381 Aug 08 18:09:01.397334 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 13/22] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:09:01 2022] GET /compute/v2.1/os-volumes/c0a1a74d-910c-45ef-b6a4-5d811f4e13b3 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 18:09:01.473579 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4bb681ce-4dc4-430c-b7df-286489aa0fcc tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed08430>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:01.524469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-4bb681ce-4dc4-430c-b7df-286489aa0fcc tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] HTTP exception thrown: Snapshot 0789340f-4865-4992-86b1-7bce8d1ddb3a could not be found. Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4bb681ce-4dc4-430c-b7df-286489aa0fcc tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Request method failure captured: Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a HTTP/1.1 Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VExyqmjwBInSG8fcBO8cV6zQt3uNo_Y_Mvnx6LtPRkusycnP_WMPr1vooRdkGx34Of5l1Hi05IU0Vtbt95SOeWklKNiEzGKEl_v0F2PnAxvIX9ERYzbcl7sSARZvauIRTZBF0tTV4aYa3EFv8JnvoX-y2Is8_Ru4MnKC3LYDRv3Pto Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 3b463a1983da46d398345bee415f1a55 Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:09:01.528042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3b463a1983da46d398345bee415f1a55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3b463a1983da46d398345bee415f1a55", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3b463a1983da46d398345bee415f1a55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3b463a1983da46d398345bee415f1a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 3b463a1983da46d398345bee415f1a55 Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesSnapshotsTestJSON-1914227865-project Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: c9cee55af1bb4dd7a7f7956ef088d59f Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1914227865-project Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Snapshot 0789340f-4865-4992-86b1-7bce8d1ddb3a could not be found. Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '0789340f-4865-4992-86b1-7bce8d1ddb3a'} Aug 08 18:09:01.529249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0789340f-4865-4992-86b1-7bce8d1ddb3a could not be found. (HTTP 404) (Request-ID: req-495f3ff7-4849-4ac3-ab47-33034264f82e) Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.529971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:09:01.530919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0789340f-4865-4992-86b1-7bce8d1ddb3a could not be found. Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 18:09:01.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0789340f-4865-4992-86b1-7bce8d1ddb3a could not be found. Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0789340f-4865-4992-86b1-7bce8d1ddb3a could not be found. Aug 08 18:09:01.533052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:01.535256 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4bb681ce-4dc4-430c-b7df-286489aa0fcc tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Returning 404 to user: Snapshot 0789340f-4865-4992-86b1-7bce8d1ddb3a could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:09:01.536941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4bb681ce-4dc4-430c-b7df-286489aa0fcc tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a" status: 404 len: 111 microversion: 2.1 time: 0.068805 Aug 08 18:09:01.538676 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 14/23] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 18:09:01 2022] GET /compute/v2.1/os-snapshots/0789340f-4865-4992-86b1-7bce8d1ddb3a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 18:09:01.568691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-05e93cc5-adda-41cf-99b6-eb45a671f7f5 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aef0bd30>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:01.883119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-05e93cc5-adda-41cf-99b6-eb45a671f7f5 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 202 len: 0 microversion: 2.1 time: 0.336255 Aug 08 18:09:01.896587 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 15/24] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:09:01 2022] DELETE /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:09:01.918666 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ef8adaea-a671-4d6e-a132-179a49c8eb0f tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aed08310>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:02.063402 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ef8adaea-a671-4d6e-a132-179a49c8eb0f tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 200 len: 344 microversion: 2.1 time: 0.165133 Aug 08 18:09:02.064262 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 16/25] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:09:01 2022] GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:02.493637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ebc16956-7016-45f9-afc2-4ebe007eb591 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: .version_select at 0x7f21aed0a280>, body: {"keypair": {"name": "tempest-keypair-1788924181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+GRSNWM4TienYEaD6Zy45oO5edj65l5utDXUL6D63fh2pTkb1jkscJ9NoPN8rhJK8sE9YqmFwnf/EKApjUn8ttzftt8+4siLearw/VxwGEGtyS30nqxhyg4WJIcTBtaw=="}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:02.640739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-ebc16956-7016-45f9-afc2-4ebe007eb591 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:02.658703 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-ebc16956-7016-45f9-afc2-4ebe007eb591 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for user 2d5e7d5c77084705b1f39406293ab585 and project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:02.824024 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ebc16956-7016-45f9-afc2-4ebe007eb591 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.739351 Aug 08 18:09:02.825536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 17/26] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:09:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:09:03.080208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d22b07e8-5994-4f0a-88c2-e056ec5509e3 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21aecee9d0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:03.257153 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d22b07e8-5994-4f0a-88c2-e056ec5509e3 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 200 len: 344 microversion: 2.1 time: 0.182187 Aug 08 18:09:03.257752 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 18/27] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:09:03 2022] GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 344 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:03.972346 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:09:03.972941 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:09:03.973505 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:09:03.973670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:09:03.974454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:09:03.999623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:04.000970 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:04.001653 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:04.002608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:04.003301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:04.004251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:04.070066 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Getting quotas for project 7b16538b6545458aa54f1edd7f5c5737. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:04.093778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Getting quotas for user ec40d2360ab2417bb2d50414575d59d0 and project 7b16538b6545458aa54f1edd7f5c5737. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:04.130305 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:09:04.138958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:09:04.272675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8693b4c7-16c4-4768-b4fd-b7ca0b3a12be tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21ae49f0d0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:04.364426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ae644eef-a99d-4432-b308-00e662e308d4 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.651581 Aug 08 18:09:04.365533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 10/28] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:09:04.380655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8693b4c7-16c4-4768-b4fd-b7ca0b3a12be tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 200 len: 344 microversion: 2.1 time: 0.113021 Aug 08 18:09:04.381701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 19/29] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:09:04 2022] GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 344 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:04.384401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-28a9c906-41cc-40f2-af74-360a10109f69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:04.385328 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-28a9c906-41cc-40f2-af74-360a10109f69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:05.085999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-28a9c906-41cc-40f2-af74-360a10109f69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:05.115486 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-28a9c906-41cc-40f2-af74-360a10109f69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1214 microversion: 2.1 time: 0.740839 Aug 08 18:09:05.124989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 11/30] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:04 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1214 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:05.399998 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-85dc2ed3-90d0-4541-b808-451683e36f27 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21ae49f790>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:05.469865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-85dc2ed3-90d0-4541-b808-451683e36f27 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] HTTP exception thrown: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-85dc2ed3-90d0-4541-b808-451683e36f27 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Request method failure captured: Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d HTTP/1.1 Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VExyqmjwBInSG8fcBO8cV6zQt3uNo_Y_Mvnx6LtPRkusycnP_WMPr1vooRdkGx34Of5l1Hi05IU0Vtbt95SOeWklKNiEzGKEl_v0F2PnAxvIX9ERYzbcl7sSARZvauIRTZBF0tTV4aYa3EFv8JnvoX-y2Is8_Ru4MnKC3LYDRv3Pto Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 3b463a1983da46d398345bee415f1a55 Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:09:05.472189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3b463a1983da46d398345bee415f1a55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3b463a1983da46d398345bee415f1a55", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3b463a1983da46d398345bee415f1a55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3b463a1983da46d398345bee415f1a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 3b463a1983da46d398345bee415f1a55 Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesSnapshotsTestJSON-1914227865-project Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: c9cee55af1bb4dd7a7f7956ef088d59f Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1914227865-project Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '1b66e7ea-e862-4eb9-9052-60f77a81977d'} Aug 08 18:09:05.473460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. (HTTP 404) (Request-ID: req-01a763df-4de2-4de4-afa8-83491ae26a94) Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.474189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:09:05.475097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 18:09:05.476029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-85dc2ed3-90d0-4541-b808-451683e36f27 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Returning 404 to user: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-85dc2ed3-90d0-4541-b808-451683e36f27 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 404 len: 109 microversion: 2.1 time: 0.083446 Aug 08 18:09:05.482315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 20/31] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:09:05 2022] GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:09:05.491298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f54dd993-f4a2-4145-9b12-9da9294f6aa7 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21b4a6dd30>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:05.577789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-f54dd993-f4a2-4145-9b12-9da9294f6aa7 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] HTTP exception thrown: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f54dd993-f4a2-4145-9b12-9da9294f6aa7 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Request method failure captured: Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d HTTP/1.1 Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VExyqmjwBInSG8fcBO8cV6zQt3uNo_Y_Mvnx6LtPRkusycnP_WMPr1vooRdkGx34Of5l1Hi05IU0Vtbt95SOeWklKNiEzGKEl_v0F2PnAxvIX9ERYzbcl7sSARZvauIRTZBF0tTV4aYa3EFv8JnvoX-y2Is8_Ru4MnKC3LYDRv3Pto Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 3b463a1983da46d398345bee415f1a55 Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:09:05.580016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3b463a1983da46d398345bee415f1a55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3b463a1983da46d398345bee415f1a55", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3b463a1983da46d398345bee415f1a55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3b463a1983da46d398345bee415f1a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 3b463a1983da46d398345bee415f1a55 Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesSnapshotsTestJSON-1914227865-project Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: c9cee55af1bb4dd7a7f7956ef088d59f Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1914227865-project Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '1b66e7ea-e862-4eb9-9052-60f77a81977d'} Aug 08 18:09:05.581130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. (HTTP 404) (Request-ID: req-85d11ac4-5d19-4e2f-b474-d2e909611bc0) Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.581878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 18:09:05.582853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 18:09:05.583761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.585208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.587896 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f54dd993-f4a2-4145-9b12-9da9294f6aa7 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Returning 404 to user: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:09:05.589457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f54dd993-f4a2-4145-9b12-9da9294f6aa7 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 404 len: 109 microversion: 2.1 time: 0.102450 Aug 08 18:09:05.592357 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 12/32] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:09:05 2022] DELETE /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:09:05.599341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2c3d5aaa-edf6-41ef-82e9-9ef17da35a83 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Calling method '.version_select at 0x7f21adbc50d0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:05.655230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-2c3d5aaa-edf6-41ef-82e9-9ef17da35a83 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] HTTP exception thrown: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2c3d5aaa-edf6-41ef-82e9-9ef17da35a83 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Request method failure captured: Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d HTTP/1.1 Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VExyqmjwBInSG8fcBO8cV6zQt3uNo_Y_Mvnx6LtPRkusycnP_WMPr1vooRdkGx34Of5l1Hi05IU0Vtbt95SOeWklKNiEzGKEl_v0F2PnAxvIX9ERYzbcl7sSARZvauIRTZBF0tTV4aYa3EFv8JnvoX-y2Is8_Ru4MnKC3LYDRv3Pto Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 3b463a1983da46d398345bee415f1a55 Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:09:05.659647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3b463a1983da46d398345bee415f1a55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3b463a1983da46d398345bee415f1a55", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3b463a1983da46d398345bee415f1a55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3b463a1983da46d398345bee415f1a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 3b463a1983da46d398345bee415f1a55 Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1914227865 Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesSnapshotsTestJSON-1914227865-project Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: c9cee55af1bb4dd7a7f7956ef088d59f Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1914227865-project Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '1b66e7ea-e862-4eb9-9052-60f77a81977d'} Aug 08 18:09:05.665255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. (HTTP 404) (Request-ID: req-66a216f6-277e-4156-88ff-3cb3949822c7) Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.665929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:09:05.666855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 18:09:05.668404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2c3d5aaa-edf6-41ef-82e9-9ef17da35a83 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] Returning 404 to user: Volume 1b66e7ea-e862-4eb9-9052-60f77a81977d could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:09:05.670248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2c3d5aaa-edf6-41ef-82e9-9ef17da35a83 tempest-VolumesSnapshotsTestJSON-1914227865 tempest-VolumesSnapshotsTestJSON-1914227865-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d" status: 404 len: 109 microversion: 2.1 time: 0.069297 Aug 08 18:09:05.672495 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 13/33] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:09:05 2022] GET /compute/v2.1/os-volumes/1b66e7ea-e862-4eb9-9052-60f77a81977d => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 18:09:06.140388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-66f088a2-785d-43f1-b051-221124b6206e tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:06.141996 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-66f088a2-785d-43f1-b051-221124b6206e tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:06.234261 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-16e62a59-15eb-4a48-a09e-c47dcd0893f3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'create', calling method: .version_select at 0x7f21aecee160>, body: {"keypair": {"name": "tempest-keypair-1049019407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+TRZO5DkORMxOJY10Az/EhzkcaD2WlXuwukhcQcYNtkLd+4m/J/s74C56DTwPYfhpq40qhGwTMQbcQJ7M2UAHu7j3hLMVAMkp0HbraCyikjxZwt5D8Vw8SKgAqD+BVZw=="}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:06.306281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-16e62a59-15eb-4a48-a09e-c47dcd0893f3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Getting quotas for project 5de58eb192de494b809a04e638e2a291. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:06.318814 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-16e62a59-15eb-4a48-a09e-c47dcd0893f3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Getting quotas for user caf8d88ca4da4515bd9f1bec64da3375 and project 5de58eb192de494b809a04e638e2a291. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:06.446980 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-66f088a2-785d-43f1-b051-221124b6206e tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:06.461064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-66f088a2-785d-43f1-b051-221124b6206e tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1214 microversion: 2.1 time: 0.322053 Aug 08 18:09:06.462248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 14/34] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:06 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1214 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:06.494319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-16e62a59-15eb-4a48-a09e-c47dcd0893f3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.956616 Aug 08 18:09:06.502250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 21/35] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:09:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:06.702633 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-350789133", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:06.856534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] validate_networks() for [('5dd375ca-72a3-421e-81bb-77b267ce5962', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:09:07.488913 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a6689109-ac2e-4931-99b2-fbea978fa64b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:07.489692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a6689109-ac2e-4931-99b2-fbea978fa64b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:07.716121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a6689109-ac2e-4931-99b2-fbea978fa64b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:07.739428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a6689109-ac2e-4931-99b2-fbea978fa64b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1214 microversion: 2.1 time: 0.255882 Aug 08 18:09:07.741258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 22/36] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:07 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:08.245291 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:09:08.246286 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:09:08.246695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:09:08.247581 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:09:08.248184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:09:08.275656 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:08.275656 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:08.275656 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:08.276482 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:08.279835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:08.280286 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:08.356967 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Getting quotas for project 34b812a3f98747eeac35fbc27a342ab0. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:08.372445 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Getting quotas for user 4c7a6c1d08554db09d65394ec338f8b5 and project 34b812a3f98747eeac35fbc27a342ab0. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:08.408395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:09:08.415039 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:09:08.699577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2628c6c3-496f-4d82-8a71-9c847398ae3f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.234364 Aug 08 18:09:08.704261 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 15/37] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:09:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:09:08.714743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-373aa0bb-9174-427f-8065-6fa14686f668 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:08.715707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-373aa0bb-9174-427f-8065-6fa14686f668 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:08.762799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:08.763933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:08.777629 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:08.781394 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:08.810010 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:08.810956 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:08.812203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:08.814999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:08.872156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-373aa0bb-9174-427f-8065-6fa14686f668 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:08.888647 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-373aa0bb-9174-427f-8065-6fa14686f668 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1221 microversion: 2.1 time: 0.169949 Aug 08 18:09:08.888647 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 23/38] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:08 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1221 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:09.160772 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e1ea3da6-4ee1-4d05-95ba-51ab6de6fc9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'create', calling method: .version_select at 0x7f21ae468c10>, body: {"keypair": {"name": "tempest-keypair-887107204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNiv+zivFRffCc94a+knYenEmrJPN7Iyze/i4Mm5YwzHw68Xrx3mxmwhWz/SHTz/dpWf/LwnsROw0u+ILtN1Lq5GYWRylRXMXKgKoUvc+U86U4Ik0V6ZVyYBXtL+4Wj6w=="}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:09.238519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-e1ea3da6-4ee1-4d05-95ba-51ab6de6fc9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Getting quotas for project cf197791c8734703b20784498cd8dcd5. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:09.250793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:09.271640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b0eb15de-ac1d-4d0c-935f-39837f597b52 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1210 microversion: 2.1 time: 0.513330 Aug 08 18:09:09.271640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 16/39] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:08 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1210 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:09.275922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-e1ea3da6-4ee1-4d05-95ba-51ab6de6fc9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Getting quotas for user 2ec53f935a6c41f2af67e9fd2e13e12c and project cf197791c8734703b20784498cd8dcd5. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:09.321931 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-638958676", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:09.399677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] validate_networks() for [('5dd375ca-72a3-421e-81bb-77b267ce5962', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:09:09.426856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e1ea3da6-4ee1-4d05-95ba-51ab6de6fc9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.536479 Aug 08 18:09:09.435960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 24/40] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Aug 8 18:09:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 546 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 18:09:10.299533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:10.300377 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:10.326400 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:10.327452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:10.328212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:10.329154 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:10.332001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:10.332677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:10.681411 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:10.712476 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-af32cf16-ee73-454a-b57a-d79f199f7bc9 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1274 microversion: 2.1 time: 0.419735 Aug 08 18:09:10.729479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 25/41] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:10 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1274 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:10.907944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1126622811", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47bba831-90ff-4040-8010-199ec976c9aa"}], "security_groups": [{"name": "tempest-securitygroup--459262229"}], "key_name": "tempest-keypair-1788924181", "user_data": "}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:11.143669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:09:11.146047 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:09:11.146619 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:09:11.147118 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:09:11.147614 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:09:11.178353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:11.178353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:11.178353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:11.178353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:11.178691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:11.178691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:11.247246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Getting quotas for project 34b812a3f98747eeac35fbc27a342ab0. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:11.262280 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Getting quotas for user 4c7a6c1d08554db09d65394ec338f8b5 and project 34b812a3f98747eeac35fbc27a342ab0. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:11.309904 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:09:11.317100 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:09:11.448080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] validate_networks() for [('47bba831-90ff-4040-8010-199ec976c9aa', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:09:11.536643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a1743cf8-a023-494a-9496-c7cf9dc06d8b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.218978 Aug 08 18:09:11.546406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 17/42] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:09:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:09:11.557560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-46c4c896-2bdb-4f6c-8042-fed59a0d0a06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:11.558783 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-46c4c896-2bdb-4f6c-8042-fed59a0d0a06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:11.894019 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-46c4c896-2bdb-4f6c-8042-fed59a0d0a06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:11.933860 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-46c4c896-2bdb-4f6c-8042-fed59a0d0a06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1221 microversion: 2.1 time: 0.380313 Aug 08 18:09:11.954973 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 18/43] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:11 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1221 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:11.976550 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:11.986822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:12.029187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:12.032314 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:12.036718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:12.039435 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:12.043340 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:12.045870 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:12.310165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:12.327383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d62c623f-cf25-4b70-9bb1-e35f8e2b9901 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1272 microversion: 2.1 time: 0.368747 Aug 08 18:09:12.328128 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 19/44] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:11 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:12.992459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-82cf3417-4f61-45f9-bb61-7b5e91e4ef6b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:12.994548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-82cf3417-4f61-45f9-bb61-7b5e91e4ef6b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:13.270051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-82cf3417-4f61-45f9-bb61-7b5e91e4ef6b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:13.278660 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-82cf3417-4f61-45f9-bb61-7b5e91e4ef6b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1221 microversion: 2.1 time: 0.299367 Aug 08 18:09:13.282589 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 20/45] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:12 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1221 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:13.355880 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:13.356877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:13.382896 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:13.384038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:13.388427 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:13.389503 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:13.397783 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:13.397783 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:15.291741 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:09:15.294279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:09:15.295875 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:09:15.296656 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:09:15.300532 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:09:15.323782 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:15.325712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:15.326197 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:15.326635 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:15.335169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:15.335291 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:15.336853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0bf6a76e-11b8-404c-bea8-ed6072d80d4a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 1.985474 Aug 08 18:09:15.337765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 21/46] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:13 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:15.338321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:15.358584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:15.363787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:15.384878 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:15.391045 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for user 2d5e7d5c77084705b1f39406293ab585 and project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:15.400644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:15.401202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:15.404709 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:15.405468 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:15.405950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:15.406247 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:09:15.406373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:15.410109 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:09:15.632838 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9fef0fc5-7e72-41db-9dff-370c97458482 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.735182 Aug 08 18:09:15.633943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 26/47] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:09:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 4737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 18:09:15.645601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-571bfc92-494c-45ab-b1ee-a4900c851979 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:15.646229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-571bfc92-494c-45ab-b1ee-a4900c851979 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:15.866699 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:15.887024 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-23fca401-2a95-4746-a22b-5d5f41bce95e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1281 microversion: 2.1 time: 0.546696 Aug 08 18:09:15.887672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 22/48] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:15 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1281 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:15.909264 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-571bfc92-494c-45ab-b1ee-a4900c851979 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:15.922026 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-571bfc92-494c-45ab-b1ee-a4900c851979 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1242 microversion: 2.1 time: 0.280482 Aug 08 18:09:15.923153 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 27/49] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:15 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1242 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:16.363632 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:16.364715 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:16.382239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:16.383905 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:16.383905 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:16.388320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:16.388855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:16.389305 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:16.911539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:16.918423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:16.929275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:16.941265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:16.950036 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:16.973057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:16.974577 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:16.975932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:17.326423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:17.342918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2ffb3dab-86c5-4148-90d1-e38d21e21341 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1279 microversion: 2.1 time: 0.438166 Aug 08 18:09:17.347747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 28/50] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:16 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1279 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:17.360092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:17.362767 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:17.398484 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:17.403358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:17.403358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:17.403358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:17.407032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:17.407792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:17.598470 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:17.625890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e22df783-7927-41e6-9bba-9e325eb1f916 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 1.269553 Aug 08 18:09:17.632889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 23/51] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:16 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:17.778096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:17.781510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-517604813", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36707abe-d83a-41b8-9f1e-6bcbe70a5bd4"}], "security_groups": [{"name": "tempest-securitygroup--1646081338"}], "key_name": "tempest-keypair-1049019407", "user_data": "}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:17.801946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1c62a5d5-b568-43d0-8e75-f2e8aa95f379 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1246 microversion: 2.1 time: 0.438818 Aug 08 18:09:17.801946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 29/52] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:17 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1246 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:18.317621 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] validate_networks() for [('36707abe-d83a-41b8-9f1e-6bcbe70a5bd4', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:09:18.372979 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:18.373756 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:18.386586 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:18.387133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:18.387588 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:18.388331 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:18.388834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:18.389267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:18.552482 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:18.565657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cdc9b16b-3aba-4210-9ee4-228b8da9ef29 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1279 microversion: 2.1 time: 0.197228 Aug 08 18:09:18.568743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 30/53] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:18 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:18.656808 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:18.660472 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:18.666973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:18.667473 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:18.669683 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:18.670602 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:18.671317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:18.671956 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.181142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:19.197884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-954f430c-0eda-4a9b-a740-07d8ab4b1815 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.547469 Aug 08 18:09:19.212654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 31/54] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:18 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:19.218501 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:19.219313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:19.225964 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.226781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.227548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.228462 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.229144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.229789 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.372657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:19.378442 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7d283d22-d369-4598-bd81-1372d5dc48ca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1294 microversion: 2.1 time: 0.164397 Aug 08 18:09:19.379702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 32/55] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:19 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1294 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:19.471590 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-f9a8c09b-8e70-4899-aabe-31428cad3fa2 req-dfb27d25-70e9-473b-ac40-435e78573c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b7b51b7-87db-435a-ad2e-fad2b60ec59f", "tag": "9d30c050-7285-4774-94b7-97fdea04acd0"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:19.500157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f9a8c09b-8e70-4899-aabe-31428cad3fa2 req-dfb27d25-70e9-473b-ac40-435e78573c76 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.500157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f9a8c09b-8e70-4899-aabe-31428cad3fa2 req-dfb27d25-70e9-473b-ac40-435e78573c76 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.500157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f9a8c09b-8e70-4899-aabe-31428cad3fa2 req-dfb27d25-70e9-473b-ac40-435e78573c76 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.539116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-f9a8c09b-8e70-4899-aabe-31428cad3fa2 req-dfb27d25-70e9-473b-ac40-435e78573c76 service nova] Creating event network-changed:9d30c050-7285-4774-94b7-97fdea04acd0 for instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f on hv-cinder-85236 Aug 08 18:09:19.539635 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f9a8c09b-8e70-4899-aabe-31428cad3fa2 req-dfb27d25-70e9-473b-ac40-435e78573c76 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118382) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 18:09:19.540027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f9a8c09b-8e70-4899-aabe-31428cad3fa2 req-dfb27d25-70e9-473b-ac40-435e78573c76 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118382) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 18:09:19.549249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.549745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.550178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.550917 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.551371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.554112 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.564830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.compute.rpcapi [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 18:09:19.565960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] Releasing lock "compute-rpcapi-router" {{(pid=118382) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 18:09:19.596497 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-31a15456-47d7-459d-9e60-c15a393c5802 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215284 Aug 08 18:09:19.597738 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 33/56] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:19.610572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:19.612182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:19.629182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.631084 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.632378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.638285 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.638285 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.640637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.667824 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:09:19.668400 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:09:19.668942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:09:19.669434 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:09:19.670045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:09:19.685819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.688117 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.690625 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.693027 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:19.695612 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:19.697068 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:19.762622 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Getting quotas for project 5de58eb192de494b809a04e638e2a291. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:19.769884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Getting quotas for user caf8d88ca4da4515bd9f1bec64da3375 and project 5de58eb192de494b809a04e638e2a291. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:19.785516 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:09:19.788396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:09:19.813946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:19.849844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-60cebdfa-0dcc-418d-8b54-6a7ef2c44202 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1279 microversion: 2.1 time: 0.245552 Aug 08 18:09:19.850861 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 34/57] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:19 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:19.863488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-480977008", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bef90788-2838-4cee-90da-10599bd32eb9"}], "security_groups": [{"name": "tempest-securitygroup--1109155111"}], "key_name": "tempest-keypair-887107204", "user_data": "}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:19.972712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fd676767-895d-4a2e-b801-a84fd6f957b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.196718 Aug 08 18:09:19.973361 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 24/58] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:09:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:09:19.985746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-35210529-756f-4dae-9257-a09ec3fbff11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:19.994807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-35210529-756f-4dae-9257-a09ec3fbff11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:20.132652 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-35210529-756f-4dae-9257-a09ec3fbff11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:20.142152 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] validate_networks() for [('bef90788-2838-4cee-90da-10599bd32eb9', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:09:20.142669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-35210529-756f-4dae-9257-a09ec3fbff11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1237 microversion: 2.1 time: 0.161740 Aug 08 18:09:20.143709 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 25/59] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:19 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1237 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:20.222798 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:20.224157 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:20.231673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:20.232732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:20.233381 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:20.234330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:20.234959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:20.237155 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:20.470834 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:20.482558 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d711ffc7-78e1-4cd6-a40e-a729d17a597f tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.263923 Aug 08 18:09:20.483409 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 26/60] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:20 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:20.488917 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:20.489938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:20.497989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:20.501753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:20.502410 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:20.503024 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:20.505747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:20.505747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:20.505747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:20.747956 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:20.765616 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1083a524-0c10-4b5e-b5ce-8ea254b65797 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1294 microversion: 2.1 time: 0.280779 Aug 08 18:09:20.767626 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 27/61] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:20 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1294 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:20.875036 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:20.879731 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:20.906611 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:09:20.907733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:09:20.908360 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:09:20.909605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:09:20.909868 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:20.910458 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:09:20.913092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:20.913698 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:20.916414 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:20.917083 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:20.917536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:20.928761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:20.929526 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:20.930106 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:20.931418 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:20.932024 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:20.932977 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:20.964225 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Getting quotas for project cf197791c8734703b20784498cd8dcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:09:20.969033 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Getting quotas for user 2ec53f935a6c41f2af67e9fd2e13e12c and project cf197791c8734703b20784498cd8dcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:09:20.981203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:09:20.983731 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:09:21.026172 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:21.122311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a5350118-79f1-4e95-bfb5-114dcca0488c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.270119 Aug 08 18:09:21.123870 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 35/62] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Aug 8 18:09:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 18:09:21.126601 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:21.136406 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4e90c1e2-6bb4-47df-8a88-31b3ddd5080a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:21.136965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4e90c1e2-6bb4-47df-8a88-31b3ddd5080a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:21.138482 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-560f62df-f9e9-4c46-b932-09250101e9dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.269690 Aug 08 18:09:21.139084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 28/63] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:20 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:21.169012 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9d9fcab0-1a9e-42e8-8624-679d64d1e229 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:21.169761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9d9fcab0-1a9e-42e8-8624-679d64d1e229 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:21.254564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4e90c1e2-6bb4-47df-8a88-31b3ddd5080a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:21.263602 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4e90c1e2-6bb4-47df-8a88-31b3ddd5080a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:21.265253 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4e90c1e2-6bb4-47df-8a88-31b3ddd5080a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:21.271401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4e90c1e2-6bb4-47df-8a88-31b3ddd5080a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1280 microversion: 2.20 time: 0.139743 Aug 08 18:09:21.275404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 36/64] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:21 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1280 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:09:21.308080 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9d9fcab0-1a9e-42e8-8624-679d64d1e229 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:21.316856 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9d9fcab0-1a9e-42e8-8624-679d64d1e229 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1237 microversion: 2.1 time: 0.153208 Aug 08 18:09:21.317554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 29/65] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:21 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1237 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:21.504083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:21.504919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:21.533842 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:21.536490 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:21.536490 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:21.536490 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:21.536490 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:21.536965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:21.732453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:21.743564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2f0bd3ce-1c9f-44bc-a75d-01c67ab46cda tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.244154 Aug 08 18:09:21.744166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 37/66] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:21 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:21.796217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:21.797015 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:21.814354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:21.814952 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:21.815482 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:21.816195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:21.816695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:21.817142 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:21.929199 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:21.938060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3416ed0a-da4d-46dd-8651-39e167eb3448 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1294 microversion: 2.1 time: 0.151164 Aug 08 18:09:21.940604 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 30/67] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:21 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1294 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:22.160674 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:22.161952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:22.184563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:22.186258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:22.186258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:22.186258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:22.186786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:22.187031 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:22.317882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ef02850b-daa5-40d8-b3f7-5c84c2d2d0eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:22.318635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ef02850b-daa5-40d8-b3f7-5c84c2d2d0eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:22.472313 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ef02850b-daa5-40d8-b3f7-5c84c2d2d0eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:22.477259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:22.486623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8c8fe1de-d064-4051-a444-7d732cec4fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.329416 Aug 08 18:09:22.492143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ef02850b-daa5-40d8-b3f7-5c84c2d2d0eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:22.496108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ef02850b-daa5-40d8-b3f7-5c84c2d2d0eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:22.499505 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ef02850b-daa5-40d8-b3f7-5c84c2d2d0eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1280 microversion: 2.20 time: 0.201502 Aug 08 18:09:22.501561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 38/68] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:22 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:22.507646 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:22.508257 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:22.518807 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:22.519407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:22.520381 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 31/69] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:22 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:22.524290 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:22.525311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:22.526453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:22.527030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:22.613343 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:22.627771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8f40fbdb-b9ac-46e0-9cb9-eae2fad9dcec tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1241 microversion: 2.1 time: 0.125034 Aug 08 18:09:22.628631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 39/70] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:22 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:22.769528 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:22.770465 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:22.781050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:22.781737 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:22.786445 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:22.786445 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:22.786445 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:22.786445 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:22.962299 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:22.964231 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:22.976743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:22.981703 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:22.981703 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:22.981703 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:22.987773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:22.988759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:23.261895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:23.265165 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cf490906-7e2c-40de-b696-9e516b16351c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1294 microversion: 2.1 time: 0.310102 Aug 08 18:09:23.268133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 40/71] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:22 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1294 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:23.363022 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:23.393244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8fa8a3e7-77b5-4265-b718-fc34e6aa69e3 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.607382 Aug 08 18:09:23.394047 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 32/72] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:22 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:23.507095 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:23.508061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:23.518811 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:23.519606 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:23.520195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:23.528051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:23.528944 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:23.534300 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:23.544454 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:23.550710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:23.550710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:23.550710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:23.550710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:23.551064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:23.551064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:23.551309 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:24.024838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:24.034390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:24.036567 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:24.052795 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8956cdf2-6e20-4ac1-a825-ce644a7101fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1284 microversion: 2.20 time: 0.514657 Aug 08 18:09:24.054216 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 33/73] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:23 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1284 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:24.072128 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:24.074053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:24.109614 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:24.109940 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:24.110452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:24.111489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:24.112256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:24.115082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:24.440902 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:24.466666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-646ac03c-8a58-4ee6-9700-c60569dcac0f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1289 microversion: 2.1 time: 0.411061 Aug 08 18:09:24.467258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 34/74] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:24 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1289 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:24.471861 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:24.472419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:24.502640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:24.503137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:24.503627 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:24.504348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:24.504865 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:24.511368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:24.590908 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:24.600664 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b453acf9-6394-4f04-a9cb-8160b68dd7fc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 1.096981 Aug 08 18:09:24.613076 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 41/75] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:23 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:24.633547 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:24.634285 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:24.638096 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:24.657084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-66ad172d-2d0e-4e89-a159-d1e693f52394 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1300 microversion: 2.1 time: 0.188619 Aug 08 18:09:24.657688 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 35/76] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:24 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:24.671342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:24.674724 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:24.682554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:24.687913 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:24.688467 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:24.688889 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.088853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:25.089632 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:25.099625 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:25.103826 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:25.105284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.106338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:25.107212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:25.108366 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.139533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:25.147410 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a8007222-617a-4098-916a-512cb1e86a1b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.533161 Aug 08 18:09:25.147984 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 42/77] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:24 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:25.488639 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:25.491015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:25.513799 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:25.514510 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:25.515098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.516385 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:25.517055 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:25.517633 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.592419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:25.603353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:25.620927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:25.620927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5f8a7b0c-fcfe-4d49-8ace-8d46a8a58bd6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1332 microversion: 2.20 time: 0.527972 Aug 08 18:09:25.620927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 36/78] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:25 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1332 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:09:25.640384 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:25.642173 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:25.655918 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:25.657301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:25.657805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.660325 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:25.667757 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:25.668342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:25.668957 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.672724 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b34a79b9-cdd5-42e4-ac5e-1cd144c57fbd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1297 microversion: 2.1 time: 0.187797 Aug 08 18:09:25.674382 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 43/79] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:25 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1297 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:25.698386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:25.699013 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:25.716632 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:25.718144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:25.718739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.719634 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:25.720238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:25.720861 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:25.997701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:26.022428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2149237b-3051-4d8e-b3dd-338ed6727d54 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1300 microversion: 2.1 time: 0.341130 Aug 08 18:09:26.027645 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 44/80] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:25 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1300 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:26.168158 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:26.173648 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:26.174583 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:26.175886 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c9a17a48-6039-4c8c-94c8-a346d817ab12 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.546222 Aug 08 18:09:26.179693 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 37/81] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:25 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:26.185137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:26.187500 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:26.193466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:26.194825 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:26.195674 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:26.196407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:26.223655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:26.637059 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:26.638673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:26.651084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:26.652379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:26.656050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:26.661292 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:26.662275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:26.662878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:26.735060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:27.134412 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:27.144626 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0c31b36f-fb82-4bb3-a22e-4b9d688e5746 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.977990 Aug 08 18:09:27.162994 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 45/82] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:26 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:27.170565 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:27.174028 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:27.194678 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:27.195180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:27.199794 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:27.200857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:27.204218 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:27.204865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:27.245418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:27.256898 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:27.262609 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:27.270150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b5baaadf-0979-4951-a798-1a83d1761ff9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1340 microversion: 2.20 time: 0.640161 Aug 08 18:09:27.282487 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 38/83] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:26 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1340 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:09:27.298442 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:27.300365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:27.329619 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:27.331394 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:27.336492 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:27.337599 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:27.339007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:27.339449 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:27.625316 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:27.634071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-02e97c64-7942-4aaf-8c37-593d8797bde5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1295 microversion: 2.1 time: 0.469657 Aug 08 18:09:27.634728 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 46/84] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:27 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1295 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:27.687702 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:27.700667 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0af9d0c7-f24d-4471-a524-687a72ff9048 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1300 microversion: 2.1 time: 0.416780 Aug 08 18:09:27.705046 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 39/85] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:27 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1300 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:27.720942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:27.722286 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:27.734780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:27.745603 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:27.749158 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:27.750270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:27.750972 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:27.753209 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:28.112029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-d46404c0-9fe9-46ab-81ed-89a479638497 req-dd7abf35-bb76-4f9c-bad9-248f7e0eb617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ff23cf-cf95-4e92-8641-45756fed10ae", "tag": "985fbb5e-9f16-43f2-bb21-2fb922c334d5"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:28.129966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d46404c0-9fe9-46ab-81ed-89a479638497 req-dd7abf35-bb76-4f9c-bad9-248f7e0eb617 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:28.132559 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d46404c0-9fe9-46ab-81ed-89a479638497 req-dd7abf35-bb76-4f9c-bad9-248f7e0eb617 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:28.132559 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d46404c0-9fe9-46ab-81ed-89a479638497 req-dd7abf35-bb76-4f9c-bad9-248f7e0eb617 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:28.198217 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-d46404c0-9fe9-46ab-81ed-89a479638497 req-dd7abf35-bb76-4f9c-bad9-248f7e0eb617 service nova] Creating event network-changed:985fbb5e-9f16-43f2-bb21-2fb922c334d5 for instance 18ff23cf-cf95-4e92-8641-45756fed10ae on hv-cinder-85236 Aug 08 18:09:28.214934 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-d46404c0-9fe9-46ab-81ed-89a479638497 req-dd7abf35-bb76-4f9c-bad9-248f7e0eb617 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.573440 Aug 08 18:09:28.215544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 47/86] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:28.245255 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:28.246709 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:28.255621 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:28.256420 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:28.257493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:28.259003 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:28.260637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:28.261362 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.073472 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:29.081989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f236aa7f-69ab-4f34-8524-7469dc93f167 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 1.375070 Aug 08 18:09:29.082574 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 40/87] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:27 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:29.099864 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:29.100838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:29.108858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.109811 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.110618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.111647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.112360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.113202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.223898 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:29.230947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:29.233244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:29.234709 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:29.238967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ae8118cb-b4fa-4d0e-a3b9-76b63e02e36d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 1.010996 Aug 08 18:09:29.239797 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 48/88] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:28 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:29.260026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1d3b3e34-265c-4f4a-b1a4-3ed430f248e9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1338 microversion: 2.20 time: 0.152086 Aug 08 18:09:29.260026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 41/89] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:29 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1338 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:29.260026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:29.260026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:29.261027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:29.261027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:29.261245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.261245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.261245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.267018 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.267894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.268660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.269477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.269801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.269966 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.270551 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.271195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.273333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.721672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=8 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:29.772169 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:29.780310 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:29.780458 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-71a12a9f-8dcc-4599-a78e-241d3b58909c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.536816 Aug 08 18:09:29.781279 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 42/90] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:29 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:29.809460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f82ea9c9-cc17-405c-b62a-cb2ec85cedb5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.555058 Aug 08 18:09:29.810173 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 49/91] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:29 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:29.906761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-c536908f-6c32-40fa-8cf0-e0e8ec455e05 req-b35e5992-94cb-4d2e-aecd-d034d406b396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7f0620-836d-4a7c-839b-4e8b4a731735", "tag": "a21e40e5-f7d3-406d-9c1e-3e308ac51699"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:29.922850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c536908f-6c32-40fa-8cf0-e0e8ec455e05 req-b35e5992-94cb-4d2e-aecd-d034d406b396 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.925882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c536908f-6c32-40fa-8cf0-e0e8ec455e05 req-b35e5992-94cb-4d2e-aecd-d034d406b396 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.925882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c536908f-6c32-40fa-8cf0-e0e8ec455e05 req-b35e5992-94cb-4d2e-aecd-d034d406b396 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.951952 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-c536908f-6c32-40fa-8cf0-e0e8ec455e05 req-b35e5992-94cb-4d2e-aecd-d034d406b396 service nova] Creating event network-changed:a21e40e5-f7d3-406d-9c1e-3e308ac51699 for instance db7f0620-836d-4a7c-839b-4e8b4a731735 on hv-cinder-85236 Aug 08 18:09:29.960570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c536908f-6c32-40fa-8cf0-e0e8ec455e05 req-b35e5992-94cb-4d2e-aecd-d034d406b396 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 18:09:29.960570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c536908f-6c32-40fa-8cf0-e0e8ec455e05 req-b35e5992-94cb-4d2e-aecd-d034d406b396 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 18:09:29.960570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.960570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.970492 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.972471 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:29.973117 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:29.975246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:29.989215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.compute.rpcapi [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 18:09:29.989215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] Releasing lock "compute-rpcapi-router" {{(pid=118381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 18:09:30.008523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b10a85bd-fe47-433f-8dc4-e8ee1f28ce04 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104321 Aug 08 18:09:30.009205 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 43/92] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:30.102624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:30.103256 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:30.111878 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.112361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.112815 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.113513 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.113954 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.121204 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.261382 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:30.262101 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:30.271068 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.276202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.276202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.276202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.276202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.276609 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.566995 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:30.578893 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4d109ed2-dffe-467f-81e4-c27b60030273 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.480463 Aug 08 18:09:30.590156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 50/93] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:30 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:30.599756 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:30.600380 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:30.607181 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.607856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.608353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.609065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.609771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.610194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.657386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:30.668311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-843eb3d7-15ab-4f68-916b-a6b9ce0c1b13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.411157 Aug 08 18:09:30.669243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 44/94] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:30 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:30.674249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-5dd57f31-810f-4074-af2f-eb2f4a1639a0 req-d7a9b25c-8643-4eee-af8f-4f7ab4eec45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "376e3874-5477-49ca-8bec-fa6e87c83c56", "tag": "010eb5ef-3314-4f0e-8ce7-a04d853d274b"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:30.684890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-5dd57f31-810f-4074-af2f-eb2f4a1639a0 req-d7a9b25c-8643-4eee-af8f-4f7ab4eec45d service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.685640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-5dd57f31-810f-4074-af2f-eb2f4a1639a0 req-d7a9b25c-8643-4eee-af8f-4f7ab4eec45d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.686082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-5dd57f31-810f-4074-af2f-eb2f4a1639a0 req-d7a9b25c-8643-4eee-af8f-4f7ab4eec45d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.703648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-5dd57f31-810f-4074-af2f-eb2f4a1639a0 req-d7a9b25c-8643-4eee-af8f-4f7ab4eec45d service nova] Creating event network-changed:010eb5ef-3314-4f0e-8ce7-a04d853d274b for instance 376e3874-5477-49ca-8bec-fa6e87c83c56 on hv-cinder-85236 Aug 08 18:09:30.708650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-5dd57f31-810f-4074-af2f-eb2f4a1639a0 req-d7a9b25c-8643-4eee-af8f-4f7ab4eec45d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038078 Aug 08 18:09:30.709880 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 45/95] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:30.807709 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:30.812541 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:30.813617 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:30.822147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:30.833437 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.833437 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.833611 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:30.833611 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b2cdadec-de09-4665-bdf6-7b2633512c26 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.240781 Aug 08 18:09:30.833828 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.835459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.836092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.836565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.836832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 51/96] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:30 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:30.848390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:30.849751 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:30.874135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.874531 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.875015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.875972 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:30.876442 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:30.877597 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:30.943988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=6 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:31.148241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:31.157361 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b26aec3d-e051-4e73-bc76-e962f16fa4e5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.359156 Aug 08 18:09:31.157956 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 46/97] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:30 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:31.168180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:31.176989 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f9e475ff-9384-4eb4-baa1-b5e48956d288 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.338907 Aug 08 18:09:31.178104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 52/98] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:30 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:31.602441 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:31.604796 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:31.611829 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:31.612629 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:31.613414 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:31.613895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:31.614241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:31.614670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:31.697333 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:31.700057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:31.705842 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=32 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:31.710599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:31.711686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:31.712287 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:31.714065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:31.714728 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:31.715228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:31.781838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:31.798320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-802f63a2-2dd0-496a-a481-bfc29cac14b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.197116 Aug 08 18:09:31.812770 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 47/99] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:31 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:31.856132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:31.857049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:31.865250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:31.866593 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:31.867246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:31.870225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:31.870895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:31.871522 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:31.902112 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:31.913245 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-177a18ad-73aa-4bab-8b46-b785407a309b tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.225884 Aug 08 18:09:31.914074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 53/100] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:31 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:32.036752 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:32.045363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:32.047007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:32.048138 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cc44737d-2b0c-462a-9461-2cbc9c3df038 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.196715 Aug 08 18:09:32.049041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 48/101] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:31 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:09:32.049905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-3d3e9fc5-25c1-4117-991c-4682df38418b req-96a4e212-07c3-4713-be21-6c893ff912c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d934484-9583-4162-bd95-ff93c9ff9372", "tag": "d61b8086-48eb-489f-b933-64bad8582780"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:32.061434 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-3d3e9fc5-25c1-4117-991c-4682df38418b req-96a4e212-07c3-4713-be21-6c893ff912c5 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.062059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-3d3e9fc5-25c1-4117-991c-4682df38418b req-96a4e212-07c3-4713-be21-6c893ff912c5 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.062589 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-3d3e9fc5-25c1-4117-991c-4682df38418b req-96a4e212-07c3-4713-be21-6c893ff912c5 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:32.082711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-3d3e9fc5-25c1-4117-991c-4682df38418b req-96a4e212-07c3-4713-be21-6c893ff912c5 service nova] Creating event network-changed:d61b8086-48eb-489f-b933-64bad8582780 for instance 2d934484-9583-4162-bd95-ff93c9ff9372 on hv-cinder-85236 Aug 08 18:09:32.099945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-3d3e9fc5-25c1-4117-991c-4682df38418b req-96a4e212-07c3-4713-be21-6c893ff912c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053730 Aug 08 18:09:32.100764 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 54/102] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:09:32.179145 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:32.183910 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:32.185683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.186170 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.186609 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:32.187302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.187761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.188204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:32.201184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:32.206989 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:32.208464 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.208964 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.209390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:32.210071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.210788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.210915 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:32.391446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:32.402810 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-44a3d9cd-84dc-4767-b1d4-9f0a31ce1786 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.226598 Aug 08 18:09:32.416481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 49/103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:32 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:32.417762 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:32.425443 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-dd46a5de-430d-4679-a976-5a8aa75ad8c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.230007 Aug 08 18:09:32.430588 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 55/104] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:32 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:32.820809 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:32.821425 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:32.824073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=38 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:32.829807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.830311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.830926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:32.832225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.832719 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.833316 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:32.935138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:32.935851 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:32.946436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.946436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.946436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:32.946436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:32.947082 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:32.947082 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:33.140259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:33.151397 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-48a3ad40-7667-4d9b-9a13-2aa906c74059 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.334514 Aug 08 18:09:33.166908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 50/105] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:32 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:33.166908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:33.166908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:33.171164 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:33.171736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:33.172247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:33.173251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:33.173780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:33.174777 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:33.210861 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:33.237095 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6286addf-b3c4-4524-b33f-8e093451c162 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.288812 Aug 08 18:09:33.237095 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 56/106] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:32 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:33.331636 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:33.341145 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:33.342659 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:33.343771 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-49326aca-5f45-4190-83da-8ca4a8f4e76a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.185577 Aug 08 18:09:33.344535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 51/107] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:33 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:33.424072 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:33.425021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:33.431540 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:33.432033 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:33.432859 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:33.433691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:33.434043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:33.434467 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:33.450908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:33.451938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:33.460733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:33.461474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:33.462499 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:33.463933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:33.464624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:33.468081 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:33.858901 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:33.862790 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:33.867971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-38b7e7de-dc84-4368-b23b-bffe6df9a96b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.448404 Aug 08 18:09:33.869097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 57/108] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:33 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:33.872938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9d8d5e0a-2f21-43c1-b6e2-77933a411627 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.427272 Aug 08 18:09:33.886549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 52/109] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:33 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:34.172277 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:34.173163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:34.179004 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.179481 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.179910 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.180622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.181071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.181484 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.250968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:34.251900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:34.268234 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.268234 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.268905 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.269931 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.270673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.271398 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.414733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:34.423423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-57e1dc46-ee9c-49a2-a92b-477b2b538797 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.254912 Aug 08 18:09:34.424003 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 58/110] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:34 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:34.428417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:34.429483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:34.435377 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.435858 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.436289 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.437001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.437457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.437878 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.471489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:34.480261 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4d5f03aa-0307-4b43-b61b-1097c1916c13 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.233380 Aug 08 18:09:34.481228 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 53/111] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:34 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:34.566202 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:34.575346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:34.576864 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:34.577960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3b90cc05-8f03-48c5-867a-05006c64a5d2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.153052 Aug 08 18:09:34.578513 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 59/112] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:34 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:34.891385 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:34.892059 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:34.894997 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:34.895835 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:34.898364 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.899838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.900287 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.901058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.901532 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.902179 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.902550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.903238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.903885 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:34.904797 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:34.905535 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:34.906224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:35.126138 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:35.135764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c6da47cb-b084-44a8-b479-6587bbd4982d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.247672 Aug 08 18:09:35.136231 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 54/113] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:34 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:35.140565 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:35.156282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-aa3b5df9-122a-4505-ab36-1114544d35c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.261868 Aug 08 18:09:35.156282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 60/114] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:34 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:35.445524 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:35.446238 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:35.455099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:35.455438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:35.458093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:35.458093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:35.458093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:35.458093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:35.501420 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:35.502455 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:35.508123 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:35.508645 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:35.509083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:35.509841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:35.510787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:35.511208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:35.637258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:35.640760 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:35.645038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c9743f47-6cf9-45e8-8000-a83126c34349 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.204170 Aug 08 18:09:35.645690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 55/115] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:35 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:35.657153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:35.657894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:35.664135 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:35.664893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:35.665320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:35.666065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:35.666518 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:35.666937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:35.674806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:35.682401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2131ff38-cd73-4f74-8bde-7fb423d51b56 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.184757 Aug 08 18:09:35.683219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 61/116] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:35 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:35.825392 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:35.833621 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:35.835156 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:35.836368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bf0cc6cc-c843-415c-898e-68e01254242b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.189770 Aug 08 18:09:35.836964 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 56/117] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:35 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:36.156264 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:36.156892 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:36.162996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.163471 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.163905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.164630 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.165089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.171229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.178298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:36.179422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:36.185689 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.186169 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.186758 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.187729 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.188349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.189225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.366948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:36.374812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-32084427-1c19-4078-8862-9b7740c6381f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.222914 Aug 08 18:09:36.375377 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 62/118] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:36 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:36.380535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:36.388495 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-43af498e-8bd4-43d4-8518-c3ff2c654dbc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.213921 Aug 08 18:09:36.389075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 57/119] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:36 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:36.666221 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:36.666853 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:36.672867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.673346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.673804 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.674488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.675043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.675432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.679598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:36.704652 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:36.705339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:36.711716 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.712401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.715099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.715099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.715099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.715099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.874430 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:36.882140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-65e7043c-a5db-46db-8ed4-eef1966cb845 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.219802 Aug 08 18:09:36.882953 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 63/120] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:36 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:36.887901 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:36.888715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:36.896935 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.897533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.898091 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.898829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:36.899288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:36.899726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:36.913540 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:36.923043 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7e4f43f8-93a7-47d5-9fdd-2cfd70db8328 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.222661 Aug 08 18:09:36.923843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 58/121] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:36 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:37.072305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:37.082964 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:37.084975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:37.086557 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f3b7a677-bc1a-4ad4-9ca4-4f8a0ad758f5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.202209 Aug 08 18:09:37.096246 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 64/122] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:36 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:37.395571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:37.396344 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:37.403070 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:37.403557 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:37.403997 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:37.404720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:37.405171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:37.405594 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:37.416811 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:37.416811 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:37.426532 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:37.427464 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:37.427893 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:37.428621 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:37.429229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:37.429700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:38.261299 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:38.263380 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:38.271460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-18c3029f-6495-4dea-adeb-8e339964d866 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.880095 Aug 08 18:09:38.274812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9fce9fe4-6e4b-43b9-9005-4c4658d3cfd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.868999 Aug 08 18:09:38.275656 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 59/123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:37 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:38.279675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 65/124] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:37 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:38.293791 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:38.294773 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:38.301461 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:38.308151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:38.308151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:38.308339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:38.314359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:38.314359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:38.314359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:38.314626 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:38.325511 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:38.326014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:38.327672 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:38.332150 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:38.332686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:38.333171 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:38.805728 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:38.812675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:38.818074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4204d3cb-4606-455f-8f21-bedc58064501 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.541223 Aug 08 18:09:38.819536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 60/125] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:38 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:38.823571 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c85838d6-71af-4dba-a60b-d6b9b3ad435c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.542443 Aug 08 18:09:38.824620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 66/126] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:38 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:38.825577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:38.826187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:38.833138 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:38.833794 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:38.834600 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:38.835989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:38.836723 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:38.837256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:39.011599 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:39.021350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:39.022876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:39.030546 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-422dec9d-fa90-4f42-ac2f-4417bb13a320 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.203281 Aug 08 18:09:39.030546 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 61/127] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:38 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:39.304743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:39.305543 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:39.311452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:39.313943 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:39.317273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:39.320142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:39.320661 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:39.321396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:39.321865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:39.329096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:39.334930 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:39.340457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:39.341396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:39.342360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:39.347452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:39.349754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:39.892416 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:39.901373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-978a25e3-f7d3-4385-9671-1fc57006063e tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.601545 Aug 08 18:09:39.902716 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 67/128] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:39 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:39.967613 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-1ce106d2-255f-476b-b723-88d546c41ffd req-e0a61a01-a825-4879-b18a-5ca3e57c3c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ff23cf-cf95-4e92-8641-45756fed10ae", "name": "network-vif-plugged", "status": "completed", "tag": "985fbb5e-9f16-43f2-bb21-2fb922c334d5"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:39.983774 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1ce106d2-255f-476b-b723-88d546c41ffd req-e0a61a01-a825-4879-b18a-5ca3e57c3c1a service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:39.984713 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1ce106d2-255f-476b-b723-88d546c41ffd req-e0a61a01-a825-4879-b18a-5ca3e57c3c1a service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:39.985200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1ce106d2-255f-476b-b723-88d546c41ffd req-e0a61a01-a825-4879-b18a-5ca3e57c3c1a service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.004748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-1ce106d2-255f-476b-b723-88d546c41ffd req-e0a61a01-a825-4879-b18a-5ca3e57c3c1a service nova] Creating event network-vif-plugged:985fbb5e-9f16-43f2-bb21-2fb922c334d5 for instance 18ff23cf-cf95-4e92-8641-45756fed10ae on hv-cinder-85236 Aug 08 18:09:40.014502 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-1ce106d2-255f-476b-b723-88d546c41ffd req-e0a61a01-a825-4879-b18a-5ca3e57c3c1a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110285 Aug 08 18:09:40.015118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 68/129] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:40.020768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:40.021475 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:40.029426 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.030117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.031272 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.033174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.033896 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.034625 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.139995 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:40.152008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b919f5bc-848e-4174-9659-da40a8e6b474 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.848285 Aug 08 18:09:40.153122 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 62/130] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:39 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:40.160987 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:40.162063 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:40.171250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.172276 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.172927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.173934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.175498 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.176163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.301116 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:40.612168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:40.623246 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7c4b3d99-f609-4c31-8781-08fc884ff8ec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.606667 Aug 08 18:09:40.624261 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 69/131] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:40 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:40.647340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:40.648782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:40.657471 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.658862 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.659382 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.660160 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.660854 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.662087 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.708181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:40.718461 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b55f46e5-6a15-4570-b606-a511d4ab16d6 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.563484 Aug 08 18:09:40.722045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 63/132] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:40 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:40.733267 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-8ee7e9bc-aaed-4c01-9e63-00d5b153fd23 req-20f01ce1-1fe0-48ad-b5aa-fedb65f5985d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c18185-5443-4967-832b-8cec6d6aa044", "tag": "364cbc31-b2c9-4de9-a7cd-715d07c15ee5"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:40.748462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-8ee7e9bc-aaed-4c01-9e63-00d5b153fd23 req-20f01ce1-1fe0-48ad-b5aa-fedb65f5985d service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.748978 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-8ee7e9bc-aaed-4c01-9e63-00d5b153fd23 req-20f01ce1-1fe0-48ad-b5aa-fedb65f5985d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.749407 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-8ee7e9bc-aaed-4c01-9e63-00d5b153fd23 req-20f01ce1-1fe0-48ad-b5aa-fedb65f5985d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.761348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-8ee7e9bc-aaed-4c01-9e63-00d5b153fd23 req-20f01ce1-1fe0-48ad-b5aa-fedb65f5985d service nova] Creating event network-changed:364cbc31-b2c9-4de9-a7cd-715d07c15ee5 for instance 87c18185-5443-4967-832b-8cec6d6aa044 on hv-cinder-85236 Aug 08 18:09:40.767523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-8ee7e9bc-aaed-4c01-9e63-00d5b153fd23 req-20f01ce1-1fe0-48ad-b5aa-fedb65f5985d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043794 Aug 08 18:09:40.768725 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 64/133] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:40.922253 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:40.925912 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:40.926056 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:40.930625 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:40.932360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.932488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:40.932875 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.933520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:40.933907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-dc651826-2105-41c2-bec7-6a7032214e7b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.294536 Aug 08 18:09:40.934402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:40.935248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 70/134] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:40 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:40.935380 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:40.935464 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:41.180010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:41.180988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:41.190593 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:41.190897 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:41.191344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:41.191512 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:41.192213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:41.192747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:41.193763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:41.200260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e6ec7bdb-0618-4674-b04b-2d1c8a67c9c7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.279090 Aug 08 18:09:41.201475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 65/135] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:40 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:41.349280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:41.358252 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3bd46c38-72ac-4c4d-a3aa-dacd88b4a74c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.184549 Aug 08 18:09:41.368544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 71/136] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:41 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:41.648612 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:41.649353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:41.656093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:41.656688 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:41.658519 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:41.659781 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:41.660914 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:41.662347 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:41.743246 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:41.744004 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:41.750168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:41.750731 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:41.751402 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:41.752596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:41.753261 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:41.753765 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:41.896085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:41.909015 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cc6bc56e-a63c-4cee-8e72-049617a91e71 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.264154 Aug 08 18:09:41.909601 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 66/137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:41 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:41.933344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:41.940825 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a48870df-a916-4021-9ed4-87678314970c tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.202220 Aug 08 18:09:41.943649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 72/138] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:41 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:41.957788 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:41.958611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:41.965430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:41.965914 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:41.966354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:41.967040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:41.967561 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:41.968027 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:42.097648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:42.106218 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:42.107751 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:42.109066 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-07d9fd34-a5a3-42e8-a68e-d3379686f969 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.155628 Aug 08 18:09:42.110329 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 67/139] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:41 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:42.221675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:42.222324 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:42.228496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:42.229014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:42.229447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:42.230441 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:42.230585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:42.231005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:42.381764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:42.383158 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:42.390367 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:42.391082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:42.391669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:42.392721 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:42.393360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:42.393950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:42.415337 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:42.425190 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c926a171-ff14-4118-a2ab-3321c7938cc4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.207262 Aug 08 18:09:42.431888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 73/140] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:42 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:42.551317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:42.558795 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c3f4c75e-464c-4541-b7dc-7afb78bb5649 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.180964 Aug 08 18:09:42.559373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 68/141] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:42 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:42.935133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:42.935871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:42.946229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:42.949968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:42.949968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:42.949968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:42.950660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:42.951243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:42.964591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:42.965442 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:42.981361 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:42.981888 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:42.982338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:42.983231 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:42.983696 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:42.984240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:43.174302 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:43.182545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-62995e12-6f21-423b-b967-0debadded269 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.252621 Aug 08 18:09:43.183125 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 74/142] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:42 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:43.185767 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:43.188014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:43.188818 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:43.196861 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-addc972f-d969-46e2-87d4-43116f8af03a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.234910 Aug 08 18:09:43.196861 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 69/143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:42 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:43.198383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:43.198871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:43.199309 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:43.200265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:43.200746 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:43.201216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:43.348657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:43.357982 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:43.359708 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:43.360918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3211cc47-3878-4c2f-831a-724ccaffee36 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.176780 Aug 08 18:09:43.361731 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 75/144] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:43 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:43.446060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:43.446679 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:43.452961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:43.453450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:43.453894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:43.454585 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:43.455041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:43.459279 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:43.585048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:43.586296 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:43.594315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:43.595054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:43.595914 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:43.614132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:43.615343 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:43.616031 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:43.640778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:43.650116 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-20087164-20ef-425c-87cb-db3f93c49961 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.207824 Aug 08 18:09:43.652030 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 70/145] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:43 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:43.799028 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:43.808093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-59d0354a-24f9-4205-ae24-0c658f0d2f69 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.228485 Aug 08 18:09:43.818153 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 76/146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:43 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:43.978773 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-692f4d1b-5088-446e-9209-cdf2ea07955b req-bb611312-5f91-49a8-9eef-a9224aecffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7b51b7-87db-435a-ad2e-fad2b60ec59f", "name": "network-vif-plugged", "status": "completed", "tag": "9d30c050-7285-4774-94b7-97fdea04acd0"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:43.992188 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-692f4d1b-5088-446e-9209-cdf2ea07955b req-bb611312-5f91-49a8-9eef-a9224aecffb0 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:43.992713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-692f4d1b-5088-446e-9209-cdf2ea07955b req-bb611312-5f91-49a8-9eef-a9224aecffb0 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:43.993149 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-692f4d1b-5088-446e-9209-cdf2ea07955b req-bb611312-5f91-49a8-9eef-a9224aecffb0 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.006460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-692f4d1b-5088-446e-9209-cdf2ea07955b req-bb611312-5f91-49a8-9eef-a9224aecffb0 service nova] Creating event network-vif-plugged:9d30c050-7285-4774-94b7-97fdea04acd0 for instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f on hv-cinder-85236 Aug 08 18:09:44.012712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-692f4d1b-5088-446e-9209-cdf2ea07955b req-bb611312-5f91-49a8-9eef-a9224aecffb0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038424 Aug 08 18:09:44.013500 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 71/147] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:44.205139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:44.209781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:44.223093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:44.224547 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:44.227281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.230334 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.230719 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.231417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.232857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.233290 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.236281 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.236891 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.237331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.238224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.238680 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.239107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.465187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:44.476559 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:44.482816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fd15b5b3-74c2-4c81-8aa2-7de2d98fde82 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.268074 Aug 08 18:09:44.483943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b9188f3d-8a7b-4d68-933b-2b0c21fea232 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.283705 Aug 08 18:09:44.484075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 72/148] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:44 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:44.484844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 77/149] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:44 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:44.490333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:44.491127 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:44.504039 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.504641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.505196 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.506095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.506618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.507304 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.661530 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:44.670446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:44.671479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:44.672163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:44.674705 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:44.676942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:44.678099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4c9ac79f-9709-467c-9de3-0922226f1c89 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.191963 Aug 08 18:09:44.678705 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 73/150] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:44 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:44.689472 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.689973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.690417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.691315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.691770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.701254 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.830907 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:44.831749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:44.838268 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.839112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.839739 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.840779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:44.841410 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:44.842583 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:44.912852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:44.926699 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-df045c13-1604-4e7d-a4bc-6ce5b7001ec4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.258333 Aug 08 18:09:44.940406 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 78/151] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:44 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:45.022385 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:45.030270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2a932849-bfb2-4c86-aecb-51f6914f42a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.203291 Aug 08 18:09:45.031212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 74/152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:44 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:45.516875 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:45.517533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:45.518929 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:45.520727 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:45.520959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:45.534121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:45.535882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:45.536472 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:45.538118 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:45.545644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:45.546718 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:45.547706 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:45.549351 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:45.549815 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:45.550569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:45.554531 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:45.554997 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:45.932031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:45.942713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ddfc6f0e-7e42-41cc-b515-84cd2bfcb053 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.429509 Aug 08 18:09:45.943727 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 75/153] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:45 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:45.952104 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:45.953599 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:45.954821 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:45.961708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:45.962943 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:45.963485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:45.964534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:45.965174 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:45.966178 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:45.967134 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6cc5cdaf-0bd4-4df5-97ae-edb949c50163 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1314 microversion: 2.1 time: 0.462945 Aug 08 18:09:45.972788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 79/154] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:45 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:45.982300 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:45.983192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:45.998668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:45.999067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:45.999492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:46.000183 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:46.000725 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:46.001091 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:46.036021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:46.215106 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:46.215405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:46.223917 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6a4f8bc2-1baa-4072-aa13-cb286c09369b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.248182 Aug 08 18:09:46.225073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 80/155] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:45 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:46.230611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:46.232396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:46.233817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c6abda0d-d303-407b-b0e5-f2e71f9e9252 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.287304 Aug 08 18:09:46.234584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 76/156] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:45 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:46.240283 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:46.241188 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:46.246679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-2d965074-e20d-4707-8403-ab7594b6293b req-38c1b237-a6c5-43a8-b01c-8904a33d15e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376e3874-5477-49ca-8bec-fa6e87c83c56", "name": "network-vif-plugged", "status": "completed", "tag": "010eb5ef-3314-4f0e-8ce7-a04d853d274b"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:46.248615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:46.249405 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:46.250344 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:46.251250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:46.252192 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:46.252854 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:46.263480 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-2d965074-e20d-4707-8403-ab7594b6293b req-38c1b237-a6c5-43a8-b01c-8904a33d15e8 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:46.264013 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-2d965074-e20d-4707-8403-ab7594b6293b req-38c1b237-a6c5-43a8-b01c-8904a33d15e8 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:46.264438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-2d965074-e20d-4707-8403-ab7594b6293b req-38c1b237-a6c5-43a8-b01c-8904a33d15e8 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:46.277517 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-2d965074-e20d-4707-8403-ab7594b6293b req-38c1b237-a6c5-43a8-b01c-8904a33d15e8 service nova] Creating event network-vif-plugged:010eb5ef-3314-4f0e-8ce7-a04d853d274b for instance 376e3874-5477-49ca-8bec-fa6e87c83c56 on hv-cinder-85236 Aug 08 18:09:46.283243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-2d965074-e20d-4707-8403-ab7594b6293b req-38c1b237-a6c5-43a8-b01c-8904a33d15e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056850 Aug 08 18:09:46.284080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 81/157] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:46.392769 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:46.400241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-44ec4fe7-ddcb-4044-991e-79cae0139a7e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.164501 Aug 08 18:09:46.401190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 77/158] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:46 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:46.967354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:46.968121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:46.976978 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:46.977759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:46.978965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:46.979853 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:46.980452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:46.981070 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:46.988957 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:46.989554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:46.996474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:46.997447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:46.998061 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:46.998911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:46.999514 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:47.000302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:47.190809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:47.200007 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8c567f87-e567-4158-8dea-37f18b0a3fcf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.237366 Aug 08 18:09:47.200614 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 82/159] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:46 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:47.213315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:47.217195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8ec9a7d5-e849-4d16-b336-b0aca3d8b897 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1502 microversion: 2.1 time: 0.232429 Aug 08 18:09:47.229707 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 78/160] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:46 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:47.245765 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:47.246587 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:47.252677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:47.253178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:47.253600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:47.257829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:47.257829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:47.257829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:47.261459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:47.262078 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:47.268870 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:47.269410 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:47.269839 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:47.270695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:47.271212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:47.271577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:47.484192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:47.498340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d2bd8b91-c362-4709-a78b-9ae28490136c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.256571 Aug 08 18:09:47.499442 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 83/161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:47 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:47.504627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:47.505389 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:47.508304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:47.511881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:47.512357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:47.512985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:47.513681 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:47.514190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:47.514322 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:47.514717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:47.522209 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:47.523821 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:47.525570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7a432aef-1bbe-4767-ab45-0a3cc8d6c796 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.269224 Aug 08 18:09:47.526133 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 79/162] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:47 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:47.655139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:47.664378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-77886e4c-4823-4610-b926-54a55bb197ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.163487 Aug 08 18:09:47.665085 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 84/163] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:47 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:48.222110 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:48.222725 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:48.231647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.232144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.232612 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.233318 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.233808 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.234232 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.300883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-c13d37d2-f058-451f-a9cc-fe9a0b586d3d req-d1f5e4c1-168c-404a-9350-ec5eee9de9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7f0620-836d-4a7c-839b-4e8b4a731735", "name": "network-vif-plugged", "status": "completed", "tag": "a21e40e5-f7d3-406d-9c1e-3e308ac51699"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:48.312457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-c13d37d2-f058-451f-a9cc-fe9a0b586d3d req-d1f5e4c1-168c-404a-9350-ec5eee9de9dc service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.313234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-c13d37d2-f058-451f-a9cc-fe9a0b586d3d req-d1f5e4c1-168c-404a-9350-ec5eee9de9dc service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.313837 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-c13d37d2-f058-451f-a9cc-fe9a0b586d3d req-d1f5e4c1-168c-404a-9350-ec5eee9de9dc service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.326373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-c13d37d2-f058-451f-a9cc-fe9a0b586d3d req-d1f5e4c1-168c-404a-9350-ec5eee9de9dc service nova] Creating event network-vif-plugged:a21e40e5-f7d3-406d-9c1e-3e308ac51699 for instance db7f0620-836d-4a7c-839b-4e8b4a731735 on hv-cinder-85236 Aug 08 18:09:48.332272 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-c13d37d2-f058-451f-a9cc-fe9a0b586d3d req-d1f5e4c1-168c-404a-9350-ec5eee9de9dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036282 Aug 08 18:09:48.336931 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 85/164] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:09:48.385922 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:48.395001 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-68802eb2-9f41-4fb0-a77b-ac61cb5c9e7c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.176699 Aug 08 18:09:48.395718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 80/165] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:48 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:48.519848 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:48.520730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:48.527501 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.527982 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.528419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.529164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.529616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.530049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.552986 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:48.553696 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:48.559531 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.560211 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.571493 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.572826 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.573309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.573743 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.903026 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:48.910581 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-34fc19bf-98f3-4efd-a115-24c85f623040 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.395166 Aug 08 18:09:48.911153 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 86/166] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:48 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:48.919947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:48.919947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:48.921867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.922345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.922776 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.923456 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:48.923908 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:48.924323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:48.949223 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:48.967276 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:48.969342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:48.972939 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-46bd661e-3a5b-4e04-ab1f-ecefb494500d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.427348 Aug 08 18:09:48.974198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 81/167] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:48 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:09:49.061766 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:49.069346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-70c15c84-96a4-4406-b84c-57d9223d456e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.157214 Aug 08 18:09:49.073461 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 87/168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:48 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:49.417433 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:49.418001 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:49.423953 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:49.424444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:49.424912 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:49.425648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:49.426107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:49.426530 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:49.557600 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:49.565263 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8e3250c3-fad1-43bf-8db9-8f9a4f5aa1ad tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.152454 Aug 08 18:09:49.565862 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 82/169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:49 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:49.931052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:49.931661 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:49.937662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:49.938132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:49.938557 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:49.939232 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:49.939680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:49.940094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:49.995150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:49.995851 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:50.001962 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:50.002531 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:50.003075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:50.003960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:50.004425 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:50.004942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:50.120053 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:50.128181 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-30f23753-469c-4808-a8c4-63521bc9b425 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.200863 Aug 08 18:09:50.128791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 88/170] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:49 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:50.133194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:50.133791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:50.148881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:50.148881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:50.149324 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:50.150736 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:50.151184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:50.151605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:50.170485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:50.178608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:50.182578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:50.182578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c1512d21-1e38-4078-a075-8bbf85f45aa0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.189981 Aug 08 18:09:50.182578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 83/171] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:49 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:09:50.283077 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:50.290701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d10acbec-3782-4481-85e5-60f8673ffd14 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.160905 Aug 08 18:09:50.291266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 89/172] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:50 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:50.585925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:50.586536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:50.592594 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:50.593075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:50.593512 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:50.594189 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:50.594640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:50.595060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:50.719672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:50.727153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-faa47518-917d-4dd3-8d3d-a35c54cd8861 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.145055 Aug 08 18:09:50.728204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 84/173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:50 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:51.149643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:51.150254 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:51.156972 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.157428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.157862 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.158554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.159007 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.159419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.209265 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:51.222937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:51.226361 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.226849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.227462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.228224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.228851 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.231149 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.375396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:51.383077 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fd1e5d85-711c-485b-ba8a-f96b691f403d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.237300 Aug 08 18:09:51.383651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 90/174] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:51 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:51.388919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:51.389521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:51.395449 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.396115 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.396777 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.397470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.397927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.398345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.420870 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:51.441258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:51.459657 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:51.459657 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0f228579-d7f7-47a0-bea3-ae6952a6eab4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.244073 Aug 08 18:09:51.459657 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 85/175] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:51 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:09:51.551214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:51.558812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9e45ea11-f874-402b-85f7-b0c9eed7fc52 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.174051 Aug 08 18:09:51.559380 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 91/176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:51 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:51.697093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-242edb26-79bc-471f-8ac0-634f8017183d req-85a836cf-de35-4984-bbd8-331caed752a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d934484-9583-4162-bd95-ff93c9ff9372", "name": "network-vif-plugged", "status": "completed", "tag": "d61b8086-48eb-489f-b933-64bad8582780"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:51.708522 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-242edb26-79bc-471f-8ac0-634f8017183d req-85a836cf-de35-4984-bbd8-331caed752a9 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.709395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-242edb26-79bc-471f-8ac0-634f8017183d req-85a836cf-de35-4984-bbd8-331caed752a9 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.709832 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-242edb26-79bc-471f-8ac0-634f8017183d req-85a836cf-de35-4984-bbd8-331caed752a9 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.721358 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-242edb26-79bc-471f-8ac0-634f8017183d req-85a836cf-de35-4984-bbd8-331caed752a9 service nova] Creating event network-vif-plugged:d61b8086-48eb-489f-b933-64bad8582780 for instance 2d934484-9583-4162-bd95-ff93c9ff9372 on hv-cinder-85236 Aug 08 18:09:51.729129 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-242edb26-79bc-471f-8ac0-634f8017183d req-85a836cf-de35-4984-bbd8-331caed752a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033509 Aug 08 18:09:51.740823 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 86/177] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:51.749925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:51.750748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:51.759423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33ee4cc1-afa1-4161-afe3-51d8f661c838"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:51.759573 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.759573 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.759573 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.759840 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:51.759932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.760078 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.761219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.768676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.769292 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.769845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.770774 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:51.771333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:51.771923 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:51.983496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:51.994866 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-13fa80c3-e7d4-4a6f-a861-400dddd06902 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1321 microversion: 2.1 time: 0.251112 Aug 08 18:09:51.995962 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 92/178] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:51 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:52.405711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:52.406466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:52.412793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:52.413268 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:52.413694 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:52.414363 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:52.414805 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:52.415217 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:52.550078 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:52.558096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f8ace896-38be-465a-8321-1997fc75f6ef tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1367 microversion: 2.1 time: 0.156376 Aug 08 18:09:52.558688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 93/179] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:52 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:52.563080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:52.566168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:52.569461 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:52.569943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:52.570363 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:52.571041 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:52.571488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:52.571904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:52.700398 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:52.708297 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:52.709867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:52.710956 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ac48aafb-82e9-46cb-bedd-9bd212f7a432 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.151396 Aug 08 18:09:52.711518 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 94/180] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:52 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:52.715766 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:52.716353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:52.721860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:52.722333 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:52.722759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:52.723429 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:52.723873 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:52.724284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:52.851623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:52.859700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4c8041f8-0702-4a68-aeeb-611b7a7463e1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.147254 Aug 08 18:09:52.860266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 95/181] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:52 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:53.015783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:53.016388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:53.022452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:53.022936 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:53.023368 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:53.024702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:53.024702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:53.024961 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:53.180673 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:53.190667 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e1c731f4-4471-4185-912c-b82954444aff tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1515 microversion: 2.1 time: 0.178740 Aug 08 18:09:53.191244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 96/182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:53 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:09:53.212295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:53.223583 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:53.223583 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:53.223583 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:53.223583 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:53.223960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:53.223960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:53.223960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:53.283974 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lazy-loading 'flavor' on Instance uuid 376e3874-5477-49ca-8bec-fa6e87c83c56 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:09:53.348947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:53.653821 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-68db7227-dcfc-4646-9e7c-3abd3a3d6c01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56/action" status: 200 len: 32 microversion: 2.1 time: 0.445266 Aug 08 18:09:53.654500 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 97/183] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:09:53 2022] POST /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56/action => generated 32 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:09:53.659311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:53.659993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:53.669283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:53.671293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:53.671293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:53.671293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:53.671567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:53.672343 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:53.836859 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:53.845916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-918e46b4-5cc5-4f0f-bbb1-b608df4f4eac tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1557 microversion: 2.1 time: 0.190285 Aug 08 18:09:53.848955 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 98/184] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:53 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:53.864660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:53.864660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:53.886698 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:53.893519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:53.894219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:53.895080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:53.895826 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:53.903089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:54.053303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:54.061116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c554b39b-24a7-49c1-815f-ac47135ab29a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.209848 Aug 08 18:09:54.061782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 99/185] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:53 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:54.066489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:54.067303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:54.073641 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:54.078054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:54.078054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:54.078054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:54.078054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:54.078411 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:54.150918 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bdb47b5c-a0f1-4913-92be-864864a53d2d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "POST /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.400172 Aug 08 18:09:54.156912 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 87/186] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:09:51 2022] POST /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f/os-volume_attachments => generated 194 bytes in 2403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:54.156912 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-24ba3da5-213e-42a4-8e1d-cc05e925e6bd req-6cf79d66-f476-4c79-b9ef-3bf8faaa62a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c18185-5443-4967-832b-8cec6d6aa044", "name": "network-vif-plugged", "status": "completed", "tag": "364cbc31-b2c9-4de9-a7cd-715d07c15ee5"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:54.166756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-24ba3da5-213e-42a4-8e1d-cc05e925e6bd req-6cf79d66-f476-4c79-b9ef-3bf8faaa62a1 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:54.167225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-24ba3da5-213e-42a4-8e1d-cc05e925e6bd req-6cf79d66-f476-4c79-b9ef-3bf8faaa62a1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:54.167643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-24ba3da5-213e-42a4-8e1d-cc05e925e6bd req-6cf79d66-f476-4c79-b9ef-3bf8faaa62a1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:54.187703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-24ba3da5-213e-42a4-8e1d-cc05e925e6bd req-6cf79d66-f476-4c79-b9ef-3bf8faaa62a1 service nova] Creating event network-vif-plugged:364cbc31-b2c9-4de9-a7cd-715d07c15ee5 for instance 87c18185-5443-4967-832b-8cec6d6aa044 on hv-cinder-85236 Aug 08 18:09:54.192790 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-24ba3da5-213e-42a4-8e1d-cc05e925e6bd req-6cf79d66-f476-4c79-b9ef-3bf8faaa62a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039855 Aug 08 18:09:54.193559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 88/187] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:54.200401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:54.200401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:54.206119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:54.206877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:54.207120 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:54.207828 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:54.208332 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:54.208781 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:54.219563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:54.224699 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:54.226355 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:54.227594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-09e050fa-2611-4017-9ab6-5b65eee2cdd4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.164625 Aug 08 18:09:54.228325 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 100/188] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:54 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:54.236695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:54.237390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:54.243479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:54.245119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:54.245119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:54.245673 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:54.246130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:54.246556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:54.332284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-60fd2398-4816-4fa8-b93d-48ee8038780b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137399 Aug 08 18:09:54.333124 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 89/189] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 18:09:54 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:54.399641 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:54.408068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-471cebd5-72a3-484e-a724-f4dc4a75bb9c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1363 microversion: 2.1 time: 0.178514 Aug 08 18:09:54.408767 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 101/190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:54 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:55.083834 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:55.084441 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:55.090582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.091073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.091506 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.092343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.092827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.093252 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.228293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:55.232794 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:09:55.242184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-71542b5f-24f8-4a05-ad74-45459cd9d62c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.158576 Aug 08 18:09:55.242184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 90/191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:55 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:55.251668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:55.252252 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:55.258749 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.259231 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.264968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.264968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.264968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.264968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.414074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:55.429077 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:55.429753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:55.439716 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.444569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:55.445206 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.445654 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.446946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.447628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.448092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.450871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:55.454163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e85e28e7-1bc7-433b-b4b1-86b60504e7c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.204822 Aug 08 18:09:55.455032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 102/192] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:55 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:55.589299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:55.597981 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ca36fbc7-4839-46ad-9f35-f4e22d730f66 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1550 microversion: 2.1 time: 0.172652 Aug 08 18:09:55.598699 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 91/193] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:55 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:55.621476 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:55.621968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:55.628901 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.629413 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.630733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.630733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.631501 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.632090 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.747155 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a75b22fe-026d-46b2-b744-ee6ddc7ba7a1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130256 Aug 08 18:09:55.748273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 103/194] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 18:09:55 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:55.941278 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-eb04f8ff-ca79-4790-bc0a-5e1dea293e3c req-28169b46-4f70-4b04-93ff-9fce418e46df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7f0620-836d-4a7c-839b-4e8b4a731735", "tag": "a21e40e5-f7d3-406d-9c1e-3e308ac51699"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:55.957869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-eb04f8ff-ca79-4790-bc0a-5e1dea293e3c req-28169b46-4f70-4b04-93ff-9fce418e46df service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:55.958939 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-eb04f8ff-ca79-4790-bc0a-5e1dea293e3c req-28169b46-4f70-4b04-93ff-9fce418e46df service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:55.959911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-eb04f8ff-ca79-4790-bc0a-5e1dea293e3c req-28169b46-4f70-4b04-93ff-9fce418e46df service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:55.974975 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-eb04f8ff-ca79-4790-bc0a-5e1dea293e3c req-28169b46-4f70-4b04-93ff-9fce418e46df service nova] Creating event network-changed:a21e40e5-f7d3-406d-9c1e-3e308ac51699 for instance db7f0620-836d-4a7c-839b-4e8b4a731735 on hv-cinder-85236 Aug 08 18:09:55.983187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-eb04f8ff-ca79-4790-bc0a-5e1dea293e3c req-28169b46-4f70-4b04-93ff-9fce418e46df service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047822 Aug 08 18:09:55.984812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 92/195] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:09:56.260784 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:56.262102 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:56.271902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:56.272732 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:56.273571 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:56.274867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:56.275399 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:56.276058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:56.483020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:56.483020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:56.492156 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:56.498250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:56.498250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:56.499187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:56.499659 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:56.500254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:56.628576 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:56.641319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0103d228-6147-412f-b585-a80ca25ddc42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.385880 Aug 08 18:09:56.652563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 104/196] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:56 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:57.102198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:57.111905 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:57.113637 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:57.114938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1f26e08e-12de-4e45-95f5-533ce263a660 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1406 microversion: 2.20 time: 0.639499 Aug 08 18:09:57.115506 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 93/197] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:56 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1406 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:57.664679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:57.666428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:57.686049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:57.688619 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:57.691745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:57.692196 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:57.692884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:57.693487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:57.705658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-3bdb66a8-83f2-40fc-a42f-708443dc8001 req-cd915326-dff4-41bd-bd8a-9b495a73c6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d934484-9583-4162-bd95-ff93c9ff9372", "tag": "d61b8086-48eb-489f-b933-64bad8582780"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:09:57.717257 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-3bdb66a8-83f2-40fc-a42f-708443dc8001 req-cd915326-dff4-41bd-bd8a-9b495a73c6ac service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:57.723802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-3bdb66a8-83f2-40fc-a42f-708443dc8001 req-cd915326-dff4-41bd-bd8a-9b495a73c6ac service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:57.723802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-3bdb66a8-83f2-40fc-a42f-708443dc8001 req-cd915326-dff4-41bd-bd8a-9b495a73c6ac service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:57.737607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-3bdb66a8-83f2-40fc-a42f-708443dc8001 req-cd915326-dff4-41bd-bd8a-9b495a73c6ac service nova] Creating event network-changed:d61b8086-48eb-489f-b933-64bad8582780 for instance 2d934484-9583-4162-bd95-ff93c9ff9372 on hv-cinder-85236 Aug 08 18:09:57.743622 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-3bdb66a8-83f2-40fc-a42f-708443dc8001 req-cd915326-dff4-41bd-bd8a-9b495a73c6ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041922 Aug 08 18:09:57.744246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 94/198] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:09:57.906704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:57.912662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5846e526-0b08-4bb7-9eb7-1719e38749ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.252595 Aug 08 18:09:57.930720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 105/199] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:57 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:09:58.155873 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:58.158706 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:58.177479 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:58.178378 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:58.178973 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:58.180055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:58.180733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:58.181581 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:58.466211 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:58.476793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:58.479731 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:58.481783 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c8b8c924-75f8-43d7-aaf5-b0db8b0508ca tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1599 microversion: 2.20 time: 0.340470 Aug 08 18:09:58.482923 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 95/200] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:09:58 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1599 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:09:58.509839 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:58.510388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:58.517891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:58.518374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:58.518800 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:58.519485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:58.519939 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:58.520363 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:58.616866 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-61029933-0341-4afe-bce2-5281316ba1b9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115826 Aug 08 18:09:58.625162 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 106/201] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Aug 8 18:09:58 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:09:58.935563 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:09:58.936890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:09:58.950335 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:58.951205 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:58.951805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:58.955985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:09:58.956675 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:09:58.957562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:09:59.236096 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:09:59.244301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-05c88b46-c30e-42a9-8f4a-84e6d6c5f9c1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.313551 Aug 08 18:09:59.257498 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 96/202] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:09:58 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:00.168029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-34fa8774-b0b4-40a6-ae6f-1b5e30e261f0 req-13d82138-e45b-4fca-a9b6-fa4193a317a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c18185-5443-4967-832b-8cec6d6aa044", "tag": "364cbc31-b2c9-4de9-a7cd-715d07c15ee5"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:10:00.180821 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-34fa8774-b0b4-40a6-ae6f-1b5e30e261f0 req-13d82138-e45b-4fca-a9b6-fa4193a317a2 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:00.181517 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-34fa8774-b0b4-40a6-ae6f-1b5e30e261f0 req-13d82138-e45b-4fca-a9b6-fa4193a317a2 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:00.183221 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-34fa8774-b0b4-40a6-ae6f-1b5e30e261f0 req-13d82138-e45b-4fca-a9b6-fa4193a317a2 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:00.196860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-34fa8774-b0b4-40a6-ae6f-1b5e30e261f0 req-13d82138-e45b-4fca-a9b6-fa4193a317a2 service nova] Creating event network-changed:364cbc31-b2c9-4de9-a7cd-715d07c15ee5 for instance 87c18185-5443-4967-832b-8cec6d6aa044 on hv-cinder-85236 Aug 08 18:10:00.202862 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-34fa8774-b0b4-40a6-ae6f-1b5e30e261f0 req-13d82138-e45b-4fca-a9b6-fa4193a317a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040938 Aug 08 18:10:00.204109 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 107/203] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:10:00.265962 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:00.266581 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:00.272970 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:00.273457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:00.273895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:00.274588 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:00.275154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:00.275792 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:00.670545 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:00.685219 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fbd0d4b8-9e0b-4d03-854a-2716bbd88c39 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.421849 Aug 08 18:10:00.687330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 97/204] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:00 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:01.357510 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:01.358094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:01.375761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:01.375761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:01.375761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:01.375761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:01.376065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:01.376065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:01.402644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Going to try to terminate instance {{(pid=118382) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:10:01.709330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:01.709951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:01.717452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:01.718224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:01.718866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:01.719575 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:01.720063 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:01.728481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:01.746032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-19e7c37b-ea3c-4e55-af36-6d0ab42f2a3d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 204 len: 0 microversion: 2.1 time: 0.393983 Aug 08 18:10:01.746717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 108/205] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:10:01 2022] DELETE /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:10:01.762959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:01.763723 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:01.772959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:01.774131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:01.777061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:01.777852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:01.778320 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:01.778745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:02.058852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:02.061354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:02.075210 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-85a85954-ed54-4595-811a-f22614a2dea8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.365447 Aug 08 18:10:02.076046 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 98/206] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:01 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:10:02.076967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d4f4a38b-8f61-436a-81c2-99bddd4cbf8a tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1554 microversion: 2.1 time: 0.319537 Aug 08 18:10:02.077973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 109/207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:01 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1554 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:10:03.097386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:03.098644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:03.102081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:03.102785 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:03.107483 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:03.108012 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:03.111490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:03.111490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:03.111490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:03.111490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:03.111848 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:03.112232 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:03.112808 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:03.113569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:03.114094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:03.114585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:03.314357 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:03.317320 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:03.322348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6fe93fef-2d7a-4507-8dc9-abc9a24955f9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.229939 Aug 08 18:10:03.323431 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 99/208] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:03 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:03.326706 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4a487c5b-3cb5-4f36-84bd-cc07c4c4aead tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1554 microversion: 2.1 time: 0.231105 Aug 08 18:10:03.327281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 110/209] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:03 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1554 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:04.343929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:04.344621 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:04.349496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:04.351054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:04.352043 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:04.352712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:04.353354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:04.354319 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:04.354839 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:04.355421 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:04.360096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:04.361094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:04.361995 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:04.362918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:04.363381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:04.363982 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:04.583512 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:04.586690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:04.595147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-db4dfcb3-8d18-45e4-84e2-e571df50ff69 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1554 microversion: 2.1 time: 0.251436 Aug 08 18:10:04.595662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 111/210] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:04 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1554 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:04.597737 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7293c730-98dc-4380-9acf-5bc70985088f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.257773 Aug 08 18:10:04.598521 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 100/211] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:04 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:05.618512 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:05.619076 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:05.619733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:05.619916 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:05.625701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:05.626406 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:05.626839 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:05.626949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:05.627402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:05.627537 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:05.627976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:05.628110 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:05.628392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:05.629054 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:05.629987 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:05.630748 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:06.048194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:06.053980 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:06.070292 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-842ca425-5ef5-4e5e-af58-de9b19d8989d tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1512 microversion: 2.1 time: 0.454966 Aug 08 18:10:06.070897 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 112/212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:05 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1512 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:06.095949 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-f1dba1cc-18f3-4f1f-b760-7510bd6c5ad4 req-cd166e64-10a4-42ed-9e6a-b92a09bd3db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7b51b7-87db-435a-ad2e-fad2b60ec59f", "name": "network-vif-deleted", "tag": "9d30c050-7285-4774-94b7-97fdea04acd0"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:10:06.107165 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f1dba1cc-18f3-4f1f-b760-7510bd6c5ad4 req-cd166e64-10a4-42ed-9e6a-b92a09bd3db9 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:06.108085 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f1dba1cc-18f3-4f1f-b760-7510bd6c5ad4 req-cd166e64-10a4-42ed-9e6a-b92a09bd3db9 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:06.109319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f1dba1cc-18f3-4f1f-b760-7510bd6c5ad4 req-cd166e64-10a4-42ed-9e6a-b92a09bd3db9 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:06.123954 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-f1dba1cc-18f3-4f1f-b760-7510bd6c5ad4 req-cd166e64-10a4-42ed-9e6a-b92a09bd3db9 service nova] Creating event network-vif-deleted:9d30c050-7285-4774-94b7-97fdea04acd0 for instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f on hv-cinder-85236 Aug 08 18:10:06.129529 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-f1dba1cc-18f3-4f1f-b760-7510bd6c5ad4 req-cd166e64-10a4-42ed-9e6a-b92a09bd3db9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039472 Aug 08 18:10:06.130281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 113/213] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:10:06.160423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:06.162794 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ddc57e13-e1da-45a1-9d2c-b7ebd3efd3dd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.548206 Aug 08 18:10:06.163438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 101/214] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:05 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:10:07.110854 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:07.110854 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:07.117603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:07.118282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:07.118713 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:07.119444 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:07.119897 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:07.120321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:07.153548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:07.154082 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:07.154469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:07.154968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lazy-loading 'fault' on Instance uuid 0b7b51b7-87db-435a-ad2e-fad2b60ec59f {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:10:07.186017 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:07.187026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:07.195339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:07.195953 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:07.196549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:07.197982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:07.198984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:07.199910 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:07.209858 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d2360ab2417bb2d50414575d59d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b16538b6545458aa54f1edd7f5c5737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:07.221056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-adad3c7e-f1ac-4dc4-b89a-a52b4a0fb455 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 200 len: 1350 microversion: 2.1 time: 0.120389 Aug 08 18:10:07.224412 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 114/215] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:07 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 1350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:07.356926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:07.365213 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a5800e6c-6d69-4dc4-9928-ce21d404aca1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.183200 Aug 08 18:10:07.365786 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 102/216] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:07 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:08.249063 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:08.250421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:08.257081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:08.257654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:08.258092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:08.258789 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:08.259241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:08.259667 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:08.273669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] HTTP exception thrown: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Request method failure captured: Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f HTTP/1.1 Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE8vvaJBQAjGLspvYH_Qs5U36nKKDBRtPk97zTp8RyXuNXbGpsx2_zYqdl98UcrvvkEKKITEkwGCttY9P7M9BCu-K8Zs7uPTq4M51UJIH0OJvBpT3MqfEj3Devs9i3TnEkDoWnEZ67ajHRpAnqbaMzH49nF1RqiNQ_jLdYWHR844as Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 7b16538b6545458aa54f1edd7f5c5737 Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:10:08.278539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7b16538b6545458aa54f1edd7f5c5737", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 7b16538b6545458aa54f1edd7f5c5737 Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-DeleteServersTestJSON-795085285-project Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: ec40d2360ab2417bb2d50414575d59d0 Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-DeleteServersTestJSON-795085285-project Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.280138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '0b7b51b7-87db-435a-ad2e-fad2b60ec59f'} Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:10:08.281383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.282569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.283792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Returning 404 to user: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:10:08.283792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e273e607-50ec-47cd-8791-efd554babb48 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 404 len: 111 microversion: 2.1 time: 0.035576 Aug 08 18:10:08.283792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 115/217] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:08 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:10:08.386920 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:08.393893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:08.394429 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:08.394949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:08.395350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:08.395461 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:08.396126 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:08.396605 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:08.397026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:08.397707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:08.404615 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:08.405158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:08.405725 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:08.406515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:08.406968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:08.407394 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:08.420972 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] HTTP exception thrown: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Request method failure captured: Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f/os-volume_attachments HTTP/1.1 Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE8vvaJBQAjGLspvYH_Qs5U36nKKDBRtPk97zTp8RyXuNXbGpsx2_zYqdl98UcrvvkEKKITEkwGCttY9P7M9BCu-K8Zs7uPTq4M51UJIH0OJvBpT3MqfEj3Devs9i3TnEkDoWnEZ67ajHRpAnqbaMzH49nF1RqiNQ_jLdYWHR844as Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 7b16538b6545458aa54f1edd7f5c5737 Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:10:08.425943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7b16538b6545458aa54f1edd7f5c5737", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 7b16538b6545458aa54f1edd7f5c5737 Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-DeleteServersTestJSON-795085285-project Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: ec40d2360ab2417bb2d50414575d59d0 Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-DeleteServersTestJSON-795085285-project Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.430358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'server_id': '0b7b51b7-87db-435a-ad2e-fad2b60ec59f'} Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:10:08.431066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:08.432138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:08.433812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Returning 404 to user: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:10:08.433812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-23193ea9-ad8c-4891-9b21-55f006395bca tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036527 Aug 08 18:10:08.433812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 116/218] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:10:08 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 18:10:08.582023 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:08.593007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4a4c0507-915d-4989-b1ff-366c43bb9f25 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.210434 Aug 08 18:10:08.593570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 103/219] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:08 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:09.613695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:09.614328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:09.623627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:09.623627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:09.623627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:09.623627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:09.624027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:09.624027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:09.829062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:09.829634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:09.838406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:09.841549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:09.841549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:09.841549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:09.841549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:09.841864 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:09.847960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:09.859779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] HTTP exception thrown: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.860372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-44e2f4da-b541-4ab6-99b1-d61202a7c822 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.250420 Aug 08 18:10:09.864572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 117/220] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:09 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Request method failure captured: Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f HTTP/1.1 Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VE8vvaJBQAjGLspvYH_Qs5U36nKKDBRtPk97zTp8RyXuNXbGpsx2_zYqdl98UcrvvkEKKITEkwGCttY9P7M9BCu-K8Zs7uPTq4M51UJIH0OJvBpT3MqfEj3Devs9i3TnEkDoWnEZ67ajHRpAnqbaMzH49nF1RqiNQ_jLdYWHR844as Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 7b16538b6545458aa54f1edd7f5c5737 Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:10:09.864817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7b16538b6545458aa54f1edd7f5c5737", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 7b16538b6545458aa54f1edd7f5c5737 Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-DeleteServersTestJSON-795085285-project Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: ec40d2360ab2417bb2d50414575d59d0 Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-DeleteServersTestJSON-795085285-project Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.866241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '0b7b51b7-87db-435a-ad2e-fad2b60ec59f'} Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:10:09.867020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.868373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.869719 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Returning 404 to user: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:10:09.869719 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e3eca55f-4e71-4b4e-925b-d1650d4ac3e5 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 404 len: 111 microversion: 2.1 time: 0.044557 Aug 08 18:10:09.869719 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 104/221] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:10:09 2022] DELETE /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 18:10:09.880356 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:09.881085 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] [instance: 0b7b51b7-87db-435a-ad2e-fad2b60ec59f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:09.888775 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:09.889269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:09.889706 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:09.890425 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:09.890872 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:09.891283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:09.906117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] HTTP exception thrown: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Request method failure captured: Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f HTTP/1.1 Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE8vvaJBQAjGLspvYH_Qs5U36nKKDBRtPk97zTp8RyXuNXbGpsx2_zYqdl98UcrvvkEKKITEkwGCttY9P7M9BCu-K8Zs7uPTq4M51UJIH0OJvBpT3MqfEj3Devs9i3TnEkDoWnEZ67ajHRpAnqbaMzH49nF1RqiNQ_jLdYWHR844as Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 7b16538b6545458aa54f1edd7f5c5737 Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:10:09.907659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7b16538b6545458aa54f1edd7f5c5737", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b16538b6545458aa54f1edd7f5c5737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 7b16538b6545458aa54f1edd7f5c5737 Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-DeleteServersTestJSON-795085285 Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-DeleteServersTestJSON-795085285-project Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: ec40d2360ab2417bb2d50414575d59d0 Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-DeleteServersTestJSON-795085285-project Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.908976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '0b7b51b7-87db-435a-ad2e-fad2b60ec59f'} Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:10:09.909624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. Aug 08 18:10:09.910802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:10:09.911801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] Returning 404 to user: Instance 0b7b51b7-87db-435a-ad2e-fad2b60ec59f could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:10:09.911801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-58c8f3ae-32c4-4ffd-8572-ef8d3f28c575 tempest-DeleteServersTestJSON-795085285 tempest-DeleteServersTestJSON-795085285-project] 10.222.0.50 "GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f" status: 404 len: 111 microversion: 2.1 time: 0.032584 Aug 08 18:10:09.913616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 118/222] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:09 2022] GET /compute/v2.1/servers/0b7b51b7-87db-435a-ad2e-fad2b60ec59f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:10:10.881065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:10.881687 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:10.891668 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:10.892193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:10.892710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:10.894658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:10.895128 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:10.895579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:11.162436 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:11.171428 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e6eb43e-e67c-45b6-8a46-e4af670d593d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.293947 Aug 08 18:10:11.178884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 105/223] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:10 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:12.202397 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:12.204637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:12.223061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:12.223843 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:12.225318 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:12.228094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:12.229339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:12.231372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:12.492059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:12.506815 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d30565c0-2793-4176-8f4b-557efce693a8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.310148 Aug 08 18:10:12.507832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 119/224] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:12 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:13.530858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:13.532656 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:13.540933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:13.542192 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:13.543169 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:13.544448 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:13.545004 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:13.545518 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:13.724362 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:13.734129 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a8f0fc8c-8d3e-4c95-ba17-840aa069884d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.209419 Aug 08 18:10:13.737758 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 106/225] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:13 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:14.759461 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:14.761331 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:14.767420 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:14.768113 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:14.768655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:14.769414 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:14.769943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:14.770436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:14.956495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:14.964141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-06134040-3af9-4f34-b063-29ea6b830d16 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.208802 Aug 08 18:10:14.964732 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 120/226] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:14 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:15.987033 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:15.988452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:15.992776 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=63 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:15.996579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:16.000202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:16.000202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:16.000202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:16.000202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:16.000610 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:16.189575 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:16.199590 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a1b6577e-31b9-4835-95cf-ded95351e7fd tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.217211 Aug 08 18:10:16.200991 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 107/227] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:15 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:17.221905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:17.222523 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:17.228843 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:17.229966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:17.230662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:17.231408 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:17.231867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:17.232292 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:17.471307 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:17.482556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-65da2700-cf8f-48e6-bfac-454ef9f61898 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.264839 Aug 08 18:10:17.483149 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 121/228] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:17 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:18.503854 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:18.505060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:18.512806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:18.513548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:18.514224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:18.521270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:18.521270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:18.521270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:18.780276 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:18.793223 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ff58ea91-4704-49d2-afba-f6ea3fe90c74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.293420 Aug 08 18:10:18.813520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 108/229] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:18 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:19.818141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:19.818761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:19.820879 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:19.826695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:19.827786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:19.827933 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:19.828793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:19.829339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:19.829939 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:20.069144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:20.081296 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7d0f178e-e4bc-433c-ae29-38a614f7a6d9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.266892 Aug 08 18:10:20.082478 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 122/230] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:19 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:21.102623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:21.109960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:21.110242 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:21.110548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:21.110989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:21.112214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:21.112715 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:21.113143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:21.134038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:21.295136 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:21.303132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ac9a923f-f6dd-4928-88a6-e0851145e52a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.204372 Aug 08 18:10:21.303819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 109/231] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:21 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:10:22.333182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:22.334327 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:22.357005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:22.357628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:22.366148 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:22.366963 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:22.369810 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:22.371883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:22.563711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:22.573835 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d65e2a2e-f6c1-4eae-9911-5095a2a87856 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.245922 Aug 08 18:10:22.574708 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 123/232] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:22 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:23.595420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:23.596687 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:23.604080 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:23.605027 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:23.608435 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:23.612721 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:23.617936 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:23.619392 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:23.835694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:23.847348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e0387a9d-163b-4f0e-b8db-f3c8ffa6abf3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.256016 Aug 08 18:10:23.849474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 110/233] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:23 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:24.871620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:24.872195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:24.880374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:24.884795 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:24.885975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:24.887736 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:24.889919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:24.890453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:25.235399 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:25.247079 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-54afdc62-a54b-411a-a48e-ad54da2df87e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.379673 Aug 08 18:10:25.250172 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 124/234] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:24 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:26.269926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:26.270596 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:26.279054 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:26.279820 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:26.280327 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:26.281200 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:26.281875 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:26.282493 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:26.513641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:26.527971 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ab5abbe1-ad03-4afa-b44e-144da4c816e4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.261590 Aug 08 18:10:26.529662 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 111/235] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:26 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:27.556426 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:27.557293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:27.577648 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:27.578931 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:27.579380 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:27.580100 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:27.581383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:27.582498 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:27.798355 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:27.809419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e441730f-5c96-43ec-b267-c2293bd85ead tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.259148 Aug 08 18:10:27.809994 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 125/236] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:27 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:28.841688 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:28.843746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:28.855588 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:28.856644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:28.871830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:28.871830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:28.871830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:28.871830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:29.084828 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:29.093689 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0f300978-d2ee-444a-b713-a74bd7748d10 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.266398 Aug 08 18:10:29.107679 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 112/237] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:28 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:30.115823 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:30.116492 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:30.125303 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:30.126018 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:30.126728 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:30.127664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:30.128128 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:30.128580 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:30.305107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fda88fe5-26e5-483e-89e3-fa18d86ba85b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Action: 'create', calling method: .version_select at 0x7f21ac8080d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-143660103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAucUG/4IXRsPMiKVTN85MUiuPG/gauLbwUIN47C+M0B6012wm86/GmsD+eMbiNtFXJBlllLyj+VpSu5WPf5qzZD/LCGyf8ioYUeruolNqUuJHi1JjOsD8V0bJqYYi7h3Q=="}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:10:30.306694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:30.318359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8945a32a-df47-4f0a-b26f-6fb8a433670e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.206985 Aug 08 18:10:30.319517 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 113/238] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:30 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:10:30.325543 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-fda88fe5-26e5-483e-89e3-fa18d86ba85b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Getting quotas for project 64273458329d44edb0e2904b4011b591. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:10:30.330715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-fda88fe5-26e5-483e-89e3-fa18d86ba85b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Getting quotas for user b7d7f6721a3a40f380578391949c443b and project 64273458329d44edb0e2904b4011b591. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:10:30.479905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fda88fe5-26e5-483e-89e3-fa18d86ba85b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.658736 Aug 08 18:10:30.480553 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 126/239] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:10:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:10:31.341937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:31.343214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:31.350824 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:31.351323 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:31.351886 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:31.352778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:31.353292 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:31.353711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:31.528117 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:31.544752 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3f4ebed3-99ce-4edb-aac8-c93cb939ea54 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1521 microversion: 2.1 time: 0.206887 Aug 08 18:10:31.545915 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 114/240] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:31 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:32.567621 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:32.569139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:32.578086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:32.578996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:32.579844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:32.580856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:32.581635 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:32.582384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:32.881352 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:32.890633 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c4d136c2-fcaa-40c2-97d7-7629ce394a96 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1501 microversion: 2.1 time: 0.327744 Aug 08 18:10:32.891328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 127/241] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:32 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1501 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:32.912755 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:32.913577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:32.921355 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:32.921854 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:32.922292 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:32.923454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:32.924085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:32.924690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:33.182474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:33.190216 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-301d2ee4-cc40-4fd6-a49c-795648725694 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1516 microversion: 2.1 time: 0.282864 Aug 08 18:10:33.190874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 115/242] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:32 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:35.114991 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:10:35.117809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:35.124335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:35.125015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:35.125736 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:35.126772 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:35.127540 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:35.128174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:35.159357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lazy-loading 'flavor' on Instance uuid 18ff23cf-cf95-4e92-8641-45756fed10ae {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:10:35.395787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-612eeb0b-5a0f-47c1-92ce-9839c920e7ba tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae/action" status: 200 len: 32 microversion: 2.1 time: 0.284833 Aug 08 18:10:35.396728 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 128/243] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:10:35 2022] POST /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 18:10:35.410417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:35.411386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:35.422959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:35.423449 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:35.423894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:35.424614 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:35.425069 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:35.425485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:35.693701 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:35.704326 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-afa40eb4-b250-4dfd-a3ac-0e6e970c05b7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.300008 Aug 08 18:10:35.705130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 116/244] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:35 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:36.726588 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:36.727529 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:36.734487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:36.740715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:36.740715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:36.740715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:36.740715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:36.741205 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:36.893203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:36.902268 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-62a9989b-884b-4499-97a2-44f3544424fb tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.179783 Aug 08 18:10:36.903049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 129/245] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:36 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:37.930226 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:37.930226 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:37.932700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:37.933187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:37.933620 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:37.934341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:37.934796 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:37.935238 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:38.092260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:38.105994 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7f738345-5702-43af-ba16-9464d95421b4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.183882 Aug 08 18:10:38.106830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 117/246] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:37 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:39.129099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:39.130214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:39.137365 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:39.137938 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:39.138376 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:39.139065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:39.139513 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:39.139932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:39.144921 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:39.440737 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:39.450846 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-88595097-7f1a-4d05-8764-733e9149f3a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.327507 Aug 08 18:10:39.451966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 130/247] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:39 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:40.473268 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:40.473989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:40.481287 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:40.481717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:40.482156 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:40.482858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:40.483317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:40.483744 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:40.630634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:40.638472 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8bd0332e-77be-4639-a64a-aa5d133bf752 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.168981 Aug 08 18:10:40.639046 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 118/248] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:40 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:41.660137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:41.661137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:41.669014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=4 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:41.670550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:41.671263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:41.672028 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:41.673504 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:41.674590 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:41.675093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:41.820357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:41.838701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cf15e914-f37a-4f36-b40f-d3578f26c3d6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.182310 Aug 08 18:10:41.839369 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 131/249] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:41 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:42.859301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:42.860010 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:42.867252 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:42.867937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:42.869015 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:42.869729 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:42.870184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:42.870604 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:43.051822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:43.060984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c979195f-a076-41ac-8773-dce4f31f33a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.205363 Aug 08 18:10:43.072618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 119/250] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:42 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:43.400704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:43.401265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:43.407932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:43.408550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:43.409054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:43.409842 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:43.410372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:43.410865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:43.435549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-afc81834-5d9f-46d7-909c-abf29e6b6072 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/ips" status: 200 len: 150 microversion: 2.1 time: 0.039456 Aug 08 18:10:43.436107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 132/251] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:10:43 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:10:44.082222 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:44.083371 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:44.090150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:44.090639 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:44.091379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:44.091955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:44.092547 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:44.093342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:44.231874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:44.240780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6e48bec8-c736-42e1-af6a-decc856b5be4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.162503 Aug 08 18:10:44.241363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 120/252] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:44 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:45.133081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eafe21de-a339-4ceb-b117-e2e3acc37040"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:10:45.135910 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:45.143656 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:45.144143 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:45.144643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:45.145340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:45.145795 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:45.146430 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:45.263888 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:45.264462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:45.271166 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:45.271658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:45.272093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:45.272816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:45.273735 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:45.274318 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:45.430311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:45.439203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e93e5b6a-d8d2-4cc2-94a6-7c8eae84ce97 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.179802 Aug 08 18:10:45.439782 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 121/253] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:45 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:10:45.444640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:45.445285 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:45.452708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:45.453267 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:45.453843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:45.454539 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:45.454993 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:45.455423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:45.484099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7e80831d-622e-405e-8c01-3ec0cd98471c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/ips" status: 200 len: 147 microversion: 2.1 time: 0.043159 Aug 08 18:10:45.484945 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 122/254] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:10:45 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:10:45.976830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-582dd46e-dba0-45c4-82ee-bc08d8838142 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848059 Aug 08 18:10:45.977518 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 133/255] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:10:45 2022] POST /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:10:46.461169 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:46.461927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:46.468749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:46.469300 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:46.469756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:46.470511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:46.471030 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:46.471473 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:46.640433 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:46.648288 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cedad887-8f25-4c6e-8d0e-f016052d4daa tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.190819 Aug 08 18:10:46.649110 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 123/256] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:46 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:47.671987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:47.671987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:47.677684 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:47.678185 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:47.678601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:47.679284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:47.679733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:47.680151 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:47.845292 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:47.853744 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6a90311d-0709-433e-aba8-348d5f5753d5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.187567 Aug 08 18:10:47.854321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 134/257] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:47 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:48.874682 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:48.875228 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:48.877537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=34 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:48.882129 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:48.882606 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:48.883037 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:48.883769 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:48.884220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:48.884670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:49.068906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:49.077640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-916359dd-e015-4846-ab77-aad071ab1633 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.206817 Aug 08 18:10:49.078213 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 124/258] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:48 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:49.513415 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d09af3f-4ecf-45f2-a9ae-bf1217296233"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:10:49.518034 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:49.525381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:49.525990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:49.526479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:49.527457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:49.528013 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:49.528295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:50.104176 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:50.104820 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:50.111324 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:50.117897 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:50.117897 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:50.117897 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:50.117897 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:50.118470 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:50.256483 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:50.264190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6e66fc6f-228f-4fd2-b7aa-69018c9b09ce tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.164463 Aug 08 18:10:50.264784 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 125/259] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:50 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:50.451773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-02a61a91-159d-492c-a995-227c59b20ccb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944352 Aug 08 18:10:50.452620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 135/260] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:10:49 2022] POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:10:51.291808 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:51.292438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:51.299262 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:51.300455 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:51.300455 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:51.303092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:51.303544 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:51.304032 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:51.335020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:51.565247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:51.578459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c88e039b-ea30-4c0d-ab7a-78666ddd564a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.291091 Aug 08 18:10:51.579230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 126/261] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:51 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:52.600990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:52.602297 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:52.619972 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:52.620519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:52.620965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:52.621682 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:52.622138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:52.622561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:52.818270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:52.827755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ff1bde33-efab-4c02-a06f-fc115ef1ed92 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.231482 Aug 08 18:10:52.829142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 136/262] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:52 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:53.849390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:53.850609 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:53.857476 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:53.859130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:53.859130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:53.859130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:53.859515 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:53.860136 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:54.017584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:54.025882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-51e2943d-b93f-4a21-8829-1a49de81da58 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.180252 Aug 08 18:10:54.030095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 127/263] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:53 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:55.046786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:55.047403 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:55.053319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:10:55.055177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:55.056389 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:55.064663 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:55.076604 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:55.077609 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:55.078275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:55.244404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:55.253405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-05f27f93-15a3-46cc-b63e-f9b18e240de9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.210421 Aug 08 18:10:55.267574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 137/264] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:55 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:55.962752 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:55.963700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:55.971162 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:55.971656 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:55.972218 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:55.973020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:55.973527 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:55.974126 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:56.008969 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5db765ab-cba5-4414-b0ee-8e35ec30c27f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/ips" status: 200 len: 153 microversion: 2.20 time: 0.050545 Aug 08 18:10:56.009804 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 128/265] 10.222.0.50 () {60 vars in 1289 bytes} [Mon Aug 8 18:10:55 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/ips => generated 153 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:10:56.276361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:56.277613 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:56.285089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:56.289017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:56.292906 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:56.293948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:56.294744 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:56.295388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:56.528907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:56.537081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-42c07e8f-9e9a-41d8-8e72-a1bf4a119f18 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.265585 Aug 08 18:10:56.544366 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 138/266] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:56 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:57.561221 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:57.562006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:57.580170 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:57.582669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:57.583125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:57.588895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:57.590813 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:57.592140 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:57.923162 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:57.945395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3c1ad47d-ae96-425d-a082-ff7bf526212d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.388560 Aug 08 18:10:57.946586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 129/267] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:57 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:58.147546 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b65505b9-bc3c-46b9-8356-9ef3fcddac37 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: .version_select at 0x7f21ad291af0>, body: {"keypair": {"name": "tempest-keypair-999811953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUPE5H7m2F8n1J0BFtXe4n8W2bYYC+DxqgAsUmAvFGMPB2tJ882ErBLo2VSIqLPE6twqyY/b14wp3/ciwoOorP1S4EtCDYgEdKORrBikw/JjlDWDNpPuBWBbR7+0gzlhQ=="}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:10:58.179831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-b65505b9-bc3c-46b9-8356-9ef3fcddac37 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:10:58.185137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-b65505b9-bc3c-46b9-8356-9ef3fcddac37 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for user 2d5e7d5c77084705b1f39406293ab585 and project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:10:58.311766 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b65505b9-bc3c-46b9-8356-9ef3fcddac37 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171798 Aug 08 18:10:58.312647 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 139/268] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:10:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:10:58.857265 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:10:58.858335 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:58.868591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:58.872810 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:58.873259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:58.873977 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:58.875335 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:58.876430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:58.928291 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lazy-loading 'flavor' on Instance uuid 87c18185-5443-4967-832b-8cec6d6aa044 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:10:58.971049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:58.971669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:58.990158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:58.990158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:58.990158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:58.990964 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:58.991332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:58.991767 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:59.264172 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:59.278105 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-91039a5f-d1b6-47f7-9425-5c6c53964c99 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.310616 Aug 08 18:10:59.278700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 140/269] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:10:58 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:10:59.667496 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-134ae2d0-c6e3-40d7-a3a1-699d772a97c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/action" status: 202 len: 0 microversion: 2.20 time: 0.815233 Aug 08 18:10:59.668107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 130/270] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Aug 8 18:10:58 2022] POST /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/action => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:10:59.676709 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:10:59.677477 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:10:59.684867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:59.685730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:59.686405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:59.687329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:10:59.688028 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:10:59.688911 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:10:59.934104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:59.943521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:59.952437 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:10:59.955791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-11e0684e-c3bc-4b85-ae5b-28025107bd22 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.283453 Aug 08 18:10:59.956368 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 141/271] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:10:59 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:00.301643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:00.303438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:00.312573 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:00.313368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:00.315422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:00.317264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:00.317906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:00.318343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:00.598407 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:00.606480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-756f80eb-e156-4634-80df-cabfecea9bf7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.310597 Aug 08 18:11:00.607183 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 131/272] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:00 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:00.981445 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:00.982744 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:00.994147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:00.994755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:00.995385 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:00.996084 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:00.997109 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:00.997696 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:01.138520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1222935875", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47bba831-90ff-4040-8010-199ec976c9aa"}], "security_groups": [{"name": "tempest-securitygroup--1397293134"}], "key_name": "tempest-keypair-999811953", "user_data": "}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:01.220590 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:01.228807 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:01.232587 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:01.233878 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0ffc82c4-0980-4773-a460-1848c191c5eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.257030 Aug 08 18:11:01.234516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 142/273] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:00 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:01.289404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] validate_networks() for [('47bba831-90ff-4040-8010-199ec976c9aa', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:11:01.627880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:01.629010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:01.637823 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:01.638521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:01.639116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:01.640068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:01.640703 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:01.641272 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:01.919238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:01.928421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-47bc8394-7a87-45f3-be60-fcef2115f8ed tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.304302 Aug 08 18:11:01.932643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 143/274] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:01 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:02.260374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:02.264070 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:02.280383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:02.282289 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:02.284104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:02.290241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:02.291304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:02.291304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:02.296037 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:11:02.297296 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:11:02.298077 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:11:02.298796 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:11:02.300210 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:11:02.321382 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:02.321939 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:02.322704 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:02.323477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:02.324388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:02.325009 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:02.379036 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:11:02.385960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for user 2d5e7d5c77084705b1f39406293ab585 and project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:11:02.410939 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:11:02.413033 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:11:02.548576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-585747cf-86c5-4d92-8973-fcd86258eaff tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.414138 Aug 08 18:11:02.549539 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 132/275] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:11:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 18:11:02.561968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0c78b71c-0afa-43f6-afdd-e640da82df6d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:02.562747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0c78b71c-0afa-43f6-afdd-e640da82df6d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:02.589310 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:02.605129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:02.606823 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:02.608022 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c395d7f3-3219-40d4-8292-1249becdf3fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.353405 Aug 08 18:11:02.609161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 144/276] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:02 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:02.686736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0c78b71c-0afa-43f6-afdd-e640da82df6d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:02.693690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0c78b71c-0afa-43f6-afdd-e640da82df6d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1241 microversion: 2.1 time: 0.135989 Aug 08 18:11:02.694561 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 133/277] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:02 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:02.954530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:02.956745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:02.965881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:02.967750 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:02.968437 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:02.969393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:02.970110 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:02.970755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:02.991606 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:03.247235 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:03.258692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fc81c696-5a2b-45fe-a863-0c6dc019e304 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.311819 Aug 08 18:11:03.272680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 145/278] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:02 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:03.633511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:03.634229 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:03.640966 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:03.641467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:03.641892 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:03.642581 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:03.643044 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:03.643587 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:03.714580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:03.715186 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:03.722467 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:03.723359 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:03.724015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:03.725335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:03.725793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:03.726206 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:03.840041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:03.848559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:03.850376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:03.851740 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e9006402-71ef-4ad0-8e12-86c5d5c8f578 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.222550 Aug 08 18:11:03.852301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 134/279] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:03 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:03.868345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:03.875894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-07baf8c6-d510-42d9-86ac-e0ce146ca61b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1245 microversion: 2.1 time: 0.165571 Aug 08 18:11:03.876456 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 146/280] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:03 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1245 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:04.289465 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:04.290745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:04.303129 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:04.304130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:04.304970 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:04.305987 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:04.306447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:04.308306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:04.667815 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:04.683802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-24eefd6e-4802-4bb9-8ae6-76c71f8f29a5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1502 microversion: 2.1 time: 0.400720 Aug 08 18:11:04.686834 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 135/281] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:04 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:04.710093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e71bae9-2851-47c6-8353-ab52a0684d70"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:04.712969 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:04.719751 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:04.720315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:04.720877 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:04.721643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:04.722167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:04.722677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:04.753263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] HTTP exception thrown: Cannot 'attach_volume' instance 18ff23cf-cf95-4e92-8641-45756fed10ae while it is in vm_state rescued Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Request method failure captured: Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: POST /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae/os-volume_attachments HTTP/1.1 Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 74 Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFBJBvNIm8XO1o8nN70rM82JzCWThocYUlsFdB_3inGl2Ht2Ok5s6cLQPQm16uUMwEw_YZovD4MX6nOwbs-9NOtLX3YCSTDvhVzznPguIbY9onCuhox29kZtgl8DnU-CYK2a7fiU_F3st4_DuOuelqdgPGett66k1D1zpaEJHLz88E Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:11:04.755317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_34b812a3f98747eeac35fbc27a342ab0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 4c7a6c1d08554db09d65394ec338f8b5 Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {"volumeAttachment": {"volumeId": "0e71bae9-2851-47c6-8353-ab52a0684d70"}} Aug 08 18:11:04.756687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Cannot 'attach_volume' instance 18ff23cf-cf95-4e92-8641-45756fed10ae while it is in vm_state rescued Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'server_id': '18ff23cf-cf95-4e92-8641-45756fed10ae', 'body': {'volumeAttachment': {'volumeId': '0e71bae9-2851-47c6-8353-ab52a0684d70'}}} Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 18ff23cf-cf95-4e92-8641-45756fed10ae in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:11:04.757432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 18ff23cf-cf95-4e92-8641-45756fed10ae while it is in vm_state rescued Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:11:04.759248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:11:04.760536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:11:04.760536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:11:04.760536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 18ff23cf-cf95-4e92-8641-45756fed10ae while it is in vm_state rescued Aug 08 18:11:04.760536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:11:04.768182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Returning 409 to user: Cannot 'attach_volume' instance 18ff23cf-cf95-4e92-8641-45756fed10ae while it is in vm_state rescued {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:11:04.768182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-952ef031-254d-4f02-ace6-fd13030fe030 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056789 Aug 08 18:11:04.768182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 147/282] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:11:04 2022] POST /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 18:11:04.773951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:04.775455 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:04.783111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:04.783720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:04.784266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:04.785598 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:04.786314 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:04.787301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:04.876182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:04.876961 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:04.886647 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:04.887136 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:04.890965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:04.890965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:04.890965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:04.890965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:05.056342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-24b9e0da-58c7-4e88-8933-17a87e092a5c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae/action" status: 202 len: 0 microversion: 2.1 time: 0.288109 Aug 08 18:11:05.059966 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 136/283] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:11:04 2022] POST /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:11:05.063331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:05.064194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:05.065781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:05.069790 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:05.070273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:05.071234 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:05.071933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:05.072383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:05.072837 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:05.078275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:05.082665 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:05.083436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-94cf1130-7b9f-4408-8f4c-3aacb293fc43 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.210946 Aug 08 18:11:05.084102 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 148/284] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:04 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:05.090731 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:05.092255 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:05.115507 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:05.118808 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:05.119621 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:05.120782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:05.121670 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:05.122644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:05.483499 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:05.496248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1fd30de2-acac-4fa8-982e-3dd9695e5b18 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1237 microversion: 2.1 time: 0.437622 Aug 08 18:11:05.497131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 137/285] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:05 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1237 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:05.562403 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:05.573191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0b850f1d-d825-45aa-990f-7133ead0d446 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1510 microversion: 2.1 time: 0.487677 Aug 08 18:11:05.574651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 149/286] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:05 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:05.970312 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-602861773", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-143660103", "security_groups": [{"name": "tempest-secgroup-smoke-390838909"}], "networks": [{"uuid": "f73e613e-0441-450a-8341-2c1baf4385ad"}], "block_device_mapping_v2": [{"uuid": "62a6a58c-b12e-47b1-a21e-ad683f4ae856", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:06.108379 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:06.110170 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:06.125663 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:06.126487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:06.127241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:06.128186 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:06.128921 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:06.129859 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:06.158090 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] validate_networks() for [('f73e613e-0441-450a-8341-2c1baf4385ad', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:11:06.744585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:06.754004 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:06.760569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:06.762190 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6cb3766d-d04c-4b3b-8d70-570417c65019 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.658208 Aug 08 18:11:06.763925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 150/287] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:06 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:06.809588 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:06.815173 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:06.855535 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:06.856040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:06.856616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:06.857244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:06.857699 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:06.858133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:07.046876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:07.056060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-366dadd1-cb79-4f5f-abf7-6ac8ffbe96d7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1301 microversion: 2.1 time: 0.290602 Aug 08 18:11:07.057509 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 151/288] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:06 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1301 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:07.075806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:07.076418 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:07.082531 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:07.083010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:07.083450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:07.084781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:07.084781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:07.085625 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:07.620800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:11:07.620800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:11:07.620800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:11:07.620800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:11:07.620800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:11:07.636650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:07.637447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:07.638662 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:07.640240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:07.642876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:07.644726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:07.719374 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Getting quotas for project 64273458329d44edb0e2904b4011b591. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:11:07.726516 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Getting quotas for user b7d7f6721a3a40f380578391949c443b and project 64273458329d44edb0e2904b4011b591. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:11:07.850857 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:11:07.853919 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62a6a58c-b12e-47b1-a21e-ad683f4ae856',volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:11:07.959527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:07.970387 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bbeb2a48-cb34-41b0-a615-55210df5515f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1510 microversion: 2.1 time: 0.898912 Aug 08 18:11:07.974144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 152/289] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:07 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1510 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:07.981162 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:07.987261 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:08.009919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:08.018271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:08.019019 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:08.019912 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:08.020692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:08.021263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:08.215352 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=4 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:08.657874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9eee9cba-095b-4dad-a0fa-4f65d22595b3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.691393 Aug 08 18:11:08.661168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 138/290] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:11:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 18:11:08.677688 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:08.678297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:08.738608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:08.739013 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:08.739446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:08.740161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:08.759217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:08.759836 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:08.839192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:08.861122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:08.862890 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:08.864118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9a75fb58-6e7c-460a-b57f-e838941a69a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.886784 Aug 08 18:11:08.872740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 153/291] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:07 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:08.899377 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2eac9357-05b2-4c18-86e0-e3f2c305425f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:08.899990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2eac9357-05b2-4c18-86e0-e3f2c305425f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:09.115611 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2eac9357-05b2-4c18-86e0-e3f2c305425f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:09.130512 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2eac9357-05b2-4c18-86e0-e3f2c305425f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1087 microversion: 2.1 time: 0.243171 Aug 08 18:11:09.139195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 154/292] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:08 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1087 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:09.151973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:09.154629 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:09.176132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:09.177215 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:09.177881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:09.178862 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:09.180639 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:09.181220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:09.250403 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:09.253055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bd7b6bc3-a1f4-464a-8422-34a295840aca tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.579156 Aug 08 18:11:09.265655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 139/293] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:08 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:09.502416 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:09.502416 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d9b4b646-09a1-41f9-bb22-93b24b8d8657 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1510 microversion: 2.1 time: 0.329620 Aug 08 18:11:09.502416 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 155/294] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:09 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1510 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:09.898926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:09.899675 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:09.907396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:09.908136 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:09.908843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:09.910012 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:09.910247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:09.910773 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:10.067086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:10.076214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:10.077916 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:10.079100 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c3b1b0b1-9f8c-411b-bff6-8b7f8776c69f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.184424 Aug 08 18:11:10.079684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 140/295] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:09 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:10.118320 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-9cc74f98-1949-412a-973b-5d14d9b24c04 req-03a24481-72df-456b-8b74-3a9a6af2243e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb281727-027c-4c38-99bb-09d9d1997425", "tag": "0b015091-eabe-4452-b3b7-8651bd39383a"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:10.140598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9cc74f98-1949-412a-973b-5d14d9b24c04 req-03a24481-72df-456b-8b74-3a9a6af2243e service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:10.141089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9cc74f98-1949-412a-973b-5d14d9b24c04 req-03a24481-72df-456b-8b74-3a9a6af2243e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:10.141586 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9cc74f98-1949-412a-973b-5d14d9b24c04 req-03a24481-72df-456b-8b74-3a9a6af2243e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:10.158205 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-339bd921-bbe7-4058-88ef-a42d58e5edb3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:10.159279 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-339bd921-bbe7-4058-88ef-a42d58e5edb3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:10.162079 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-9cc74f98-1949-412a-973b-5d14d9b24c04 req-03a24481-72df-456b-8b74-3a9a6af2243e service nova] Creating event network-changed:0b015091-eabe-4452-b3b7-8651bd39383a for instance cb281727-027c-4c38-99bb-09d9d1997425 on hv-cinder-85236 Aug 08 18:11:10.173195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-9cc74f98-1949-412a-973b-5d14d9b24c04 req-03a24481-72df-456b-8b74-3a9a6af2243e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059113 Aug 08 18:11:10.176069 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 156/296] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:10.275165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-339bd921-bbe7-4058-88ef-a42d58e5edb3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:10.281334 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:10.282246 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:10.285710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-339bd921-bbe7-4058-88ef-a42d58e5edb3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1087 microversion: 2.1 time: 0.131767 Aug 08 18:11:10.287269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 141/297] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:10 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1087 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:10.305654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:10.308488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:10.308488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:10.308488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:10.308488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:10.309132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:10.487537 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:10.496931 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:10.497719 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:10.501966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-481b6202-f152-4307-a515-ecebb0cedc3d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.224782 Aug 08 18:11:10.504626 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 157/298] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:10 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:10.515702 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:10.516143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:10.516666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:10.519243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:10.519784 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:10.520277 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:10.674890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:10.686019 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ab04c872-31ec-4da5-82e5-09ac0048be87 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1510 microversion: 2.1 time: 0.193285 Aug 08 18:11:10.693844 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 142/299] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:10 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:11.102786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:11.103473 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:11.112366 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:11.112887 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:11.113328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:11.114030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:11.114489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:11.114915 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:11.311177 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:11.311177 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:11.313639 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:11.317020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:11.317615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:11.318530 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:11.319486 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:11.320200 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:11.323087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:11.329959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:11.337249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:11.338747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3190553a-fece-4514-b10c-077c03d06f42 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.240074 Aug 08 18:11:11.342494 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 158/300] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:11 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:11.420633 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:11.431093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:11.442795 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d40f83ce-4136-4d93-9118-a65ece410ee2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1137 microversion: 2.1 time: 0.139183 Aug 08 18:11:11.443592 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 143/301] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:11 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1137 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:11.526032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:11.527039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:11.535708 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:11.536258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:11.542852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:11.542852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:11.542852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:11.542852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:11.688760 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:11.697799 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6683e351-d28e-4382-94e0-b0e5a3d32ddb tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.176425 Aug 08 18:11:11.699410 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 159/302] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:11 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:11.709451 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:11.710301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:11.718658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:11.719516 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:11.720187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:11.721268 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:11.721987 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:11.725835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:11.890430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:11.902147 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-faba0814-cfaa-450b-a1db-442465da9b28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1516 microversion: 2.1 time: 0.196393 Aug 08 18:11:11.916983 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 144/303] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:11 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:12.370614 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:12.377106 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:12.396339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:12.397109 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:12.397826 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:12.399294 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:12.401456 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:12.408917 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:12.472489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:12.473130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:12.479999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:12.480479 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:12.489330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:12.490188 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:12.490945 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:12.491392 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:12.616548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:12.628055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f6fdc4e5-7be7-4e79-9148-9926ff4708f5 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1137 microversion: 2.1 time: 0.159348 Aug 08 18:11:12.629405 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 145/304] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:12 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1137 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:12.647995 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:12.657776 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:12.659288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:12.671041 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ee3de5af-c339-4947-9c22-f472581717ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.298213 Aug 08 18:11:12.671882 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 160/305] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:12 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:12.720407 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:12.721365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:12.732426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:12.737764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:12.737764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:12.737764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:12.737764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:12.738143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:12.906738 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:12.915814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-933d13dd-0fe4-4832-be53-424eb792ecda tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.199713 Aug 08 18:11:12.916737 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 146/306] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:12 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:13.655526 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:13.656152 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:13.662757 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:13.663234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:13.663665 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:13.665012 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:13.665601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:13.666026 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:13.698954 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:13.699714 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:13.712340 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:13.712340 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:13.712340 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:13.712340 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:13.712666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:13.712666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:13.734645 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:13.749379 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-66248fc3-563f-4231-bdfa-e510b9e0110c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1137 microversion: 2.1 time: 0.091983 Aug 08 18:11:13.749379 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 161/307] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:13 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1137 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:13.871410 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:13.879442 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:13.880982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:13.882146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6e16d0c1-cb4c-4c2a-89be-5369fd5872a2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.187861 Aug 08 18:11:13.883211 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 147/308] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:13 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:13.936838 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:13.941931 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:13.946295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:13.947369 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:13.947369 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:13.947944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:13.948394 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:13.949094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:14.087799 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:14.104950 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1515f62a-ce0d-4e7a-9153-f995411ed832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.168792 Aug 08 18:11:14.104950 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 162/309] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:13 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:14.771341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:14.772119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:14.779774 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:14.780351 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:14.780988 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:14.781760 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:14.782301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:14.782778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:14.875512 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:14.883784 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ae3e249b-75f6-4e3e-bc5c-fd27fa5b31b9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1129 microversion: 2.1 time: 0.118549 Aug 08 18:11:14.884352 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 148/310] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:14 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1129 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:14.905854 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:14.907150 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:14.916241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:14.920788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:14.921552 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:14.922365 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:14.922977 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:14.923475 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:15.124379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:15.125269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:15.126592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:15.136554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:15.136554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:15.136554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:15.137246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:15.137862 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:15.138446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:15.140262 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:15.142222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:15.146396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7cb4f468-5130-44fc-9cac-2dcefac3b678 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.241728 Aug 08 18:11:15.147072 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 163/311] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:14 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:15.403677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:15.412859 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-aaff0456-73dc-460d-80ed-954a40f1348d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.292364 Aug 08 18:11:15.413775 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 149/312] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:15 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:15.779572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-beaa2ded-37f3-4628-a220-217e9660e1a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:15.803925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-beaa2ded-37f3-4628-a220-217e9660e1a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:15.806161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-beaa2ded-37f3-4628-a220-217e9660e1a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:15.806606 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-beaa2ded-37f3-4628-a220-217e9660e1a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:15.880750 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:15.909920 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:15.914565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:15.926779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:15.934916 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:15.940650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:15.940650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:15.940650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:15.940650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:15.955357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-beaa2ded-37f3-4628-a220-217e9660e1a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Going to try to stop instance {{(pid=118382) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 18:11:16.188131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:16.196390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5d1c657b-4b06-4e15-a87a-535c41434245 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1185 microversion: 2.1 time: 0.290871 Aug 08 18:11:16.199635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 150/313] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:15 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1185 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:16.209799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2781f246-8200-43e5-9e29-effa15d73c15 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'create', calling method: .version_select at 0x7f21adbc5040>, body: {"keypair": {"name": "tempest-keypair-1364518598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO3maJo3/7uEjjnkEMqcBUQzWP9sdbyrDizHqniEi/DXkoq5c+lWlylN4xqV91+oVhwREpXjPdXyoINbkhqYAsxNyj4srpWQEvLZPe3GtjYbWJ3jD/r0GpiwPkVjy/t7g=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:16.243729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-beaa2ded-37f3-4628-a220-217e9660e1a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/action" status: 202 len: 0 microversion: 2.1 time: 0.468607 Aug 08 18:11:16.247385 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 164/314] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:11:15 2022] POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:11:16.280613 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:16.284820 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:16.295798 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-2781f246-8200-43e5-9e29-effa15d73c15 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Getting quotas for project 34b812a3f98747eeac35fbc27a342ab0. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:11:16.295948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:16.296381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:16.297658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:16.298447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:16.298973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:16.299454 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:16.317098 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-2781f246-8200-43e5-9e29-effa15d73c15 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Getting quotas for user 4c7a6c1d08554db09d65394ec338f8b5 and project 34b812a3f98747eeac35fbc27a342ab0. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:11:16.377755 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:16.472226 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2781f246-8200-43e5-9e29-effa15d73c15 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.270416 Aug 08 18:11:16.474184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 151/315] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:11:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:16.479783 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:16.483137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:16.497460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:16.498283 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:16.500436 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:16.506348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:16.507368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:16.514053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:16.714693 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:16.726951 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:16.732081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:16.733345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-66fbee1d-2a04-42be-98ae-1edff805a635 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.484121 Aug 08 18:11:16.737974 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 165/316] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:16 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:16.762323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:16.762323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:16.767825 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:16.768623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:16.769264 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:16.770122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:16.770734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:16.771327 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:16.789394 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:16.814489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0f8fcc4d-6039-497f-bf57-fb07f2750e8e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.338858 Aug 08 18:11:16.829884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 152/317] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:16 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:17.060450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:17.070762 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-258b0b34-3e65-469f-a2c9-85cf55beda1f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.319964 Aug 08 18:11:17.071695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 166/318] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:16 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:17.219683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:17.220969 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:17.228488 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:17.229000 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:17.233049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:17.233049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:17.233049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:17.233049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:17.308058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:17.315591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3b9e0810-5bb2-467c-af94-5b9ec0f1c16c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1203 microversion: 2.1 time: 0.099663 Aug 08 18:11:17.318449 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 153/319] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:17 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1203 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:17.765385 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:17.766331 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:17.772997 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:17.773564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:17.774077 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:17.774884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:17.775430 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:17.775926 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:17.863679 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:17.873883 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:17.876804 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=4 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:17.901146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:17.902231 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:17.902979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:17.903901 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:17.904416 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:17.905101 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:18.051675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:18.060452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:18.062134 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:18.063745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2e8fe495-5b70-444c-b56a-ba828665f98d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.302031 Aug 08 18:11:18.063945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 167/320] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:17 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:18.097000 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:18.098407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:18.105054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:18.105554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:18.105994 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:18.106707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:18.107166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:18.107607 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:18.251493 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:18.260112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6b9899a4-f204-4352-9285-bfd789e0056d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.428058 Aug 08 18:11:18.260949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 154/321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:17 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:18.343908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:18.344641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:18.351724 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:18.352113 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:18.352604 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:18.353336 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:18.353811 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:18.354247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:18.372462 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:18.383564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-720f07a3-8649-4f2f-9934-c1fe3c65f4f1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.290592 Aug 08 18:11:18.384304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 168/322] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:18 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:18.555108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:18.562839 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-822a99bc-86ca-41b4-acd6-e590b73440c3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1270 microversion: 2.1 time: 0.224452 Aug 08 18:11:18.563546 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 155/323] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:18 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:19.029344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-0ed077f4-93c1-4297-9aa6-48dc9f5103c9 req-21d0aebe-832c-4bab-9022-96d3fcd0ebfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d", "tag": "ba2a15cb-dff8-4775-9544-c1155b4411cf"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:19.041463 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0ed077f4-93c1-4297-9aa6-48dc9f5103c9 req-21d0aebe-832c-4bab-9022-96d3fcd0ebfc service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.074103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0ed077f4-93c1-4297-9aa6-48dc9f5103c9 req-21d0aebe-832c-4bab-9022-96d3fcd0ebfc service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.074702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0ed077f4-93c1-4297-9aa6-48dc9f5103c9 req-21d0aebe-832c-4bab-9022-96d3fcd0ebfc service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.089123 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:19.089754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:19.090624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-0ed077f4-93c1-4297-9aa6-48dc9f5103c9 req-21d0aebe-832c-4bab-9022-96d3fcd0ebfc service nova] Creating event network-changed:ba2a15cb-dff8-4775-9544-c1155b4411cf for instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d on hv-cinder-85236 Aug 08 18:11:19.097942 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-0ed077f4-93c1-4297-9aa6-48dc9f5103c9 req-21d0aebe-832c-4bab-9022-96d3fcd0ebfc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072059 Aug 08 18:11:19.098379 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 169/324] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:19.098572 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.099085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.099522 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.100269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.101104 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.101529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.279291 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:19.284076 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:19.284803 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:19.292159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.293161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.293671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.294448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.295085 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.295603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.340603 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:19.364220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:19.366210 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:19.367707 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b00c3d67-8549-422b-a8ae-886563cd2bd1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.283236 Aug 08 18:11:19.368270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 156/325] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:19 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:19.415249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:19.416037 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:19.430999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.432226 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.432226 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.432958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.433900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.443314 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.582427 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:19.593284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7255bc2b-be43-4d31-954e-9b7e5e3704c1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.314869 Aug 08 18:11:19.594213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 170/326] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:19 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:19.611806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:19.612867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:19.623319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.624007 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.624539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.625351 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:19.626586 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:19.627085 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:19.669395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:19.680855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-efa06122-2d14-413b-b618-955b1a768b40 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.269819 Aug 08 18:11:19.681456 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 157/327] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:19 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:19.686422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f6051939-26ab-4763-8008-9b856edca9f9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Action: 'create', calling method: .version_select at 0x7f21adb14940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-537330876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGyhZ6v8T6BbZrB7RLAWNeaIsh1DKweEx9ggBZ5/FDxzMGHCieypfGp2bBzTpKQdZQabcSWN9xZ93jyrJHw1CbqG76b39ZehZfifguv6VNnRJB5j5QksyLyb/162Li+Sw=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:19.713812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-f6051939-26ab-4763-8008-9b856edca9f9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Getting quotas for project c3b1914ba55849e4a3a55a20ed50e7a1. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:11:19.719523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-f6051939-26ab-4763-8008-9b856edca9f9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Getting quotas for user 6e4ebbf55d214dcc835e3f43876693bb and project c3b1914ba55849e4a3a55a20ed50e7a1. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:11:19.777613 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:19.785439 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9d5bb570-04e5-4703-a8dc-b50a3dd4bcee tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1270 microversion: 2.1 time: 0.190015 Aug 08 18:11:19.786030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 171/328] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:19 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:19.819443 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f6051939-26ab-4763-8008-9b856edca9f9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136807 Aug 08 18:11:19.820999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 158/329] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:11:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:19.863878 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1332441966", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dd375ca-72a3-421e-81bb-77b267ce5962"}], "security_groups": [{"name": "tempest-securitygroup--485684210"}], "key_name": "tempest-keypair-1364518598", "user_data": "}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:19.948093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-246803488", "imageRef": "d8d144dc-7058-4ad0-8e36-7de0284ca5ad", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-537330876", "networks": [{"uuid": "5a88f735-917c-47a6-9c66-807e1086337d"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:20.005002 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] validate_networks() for [('5a88f735-917c-47a6-9c66-807e1086337d', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:11:20.012240 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] validate_networks() for [('5dd375ca-72a3-421e-81bb-77b267ce5962', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:11:21.078865 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:11:21.079349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:11:21.079888 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:11:21.080191 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:11:21.080649 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:11:21.083791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:11:21.084228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:11:21.084731 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:11:21.085146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:11:21.087020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:11:21.092317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.092884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.093378 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.094135 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.094466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.094593 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.094945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.095058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.095412 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.096134 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.096627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.097080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.111744 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Getting quotas for project c3b1914ba55849e4a3a55a20ed50e7a1. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:11:21.115790 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Getting quotas for project 34b812a3f98747eeac35fbc27a342ab0. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:11:21.115908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Getting quotas for user 6e4ebbf55d214dcc835e3f43876693bb and project c3b1914ba55849e4a3a55a20ed50e7a1. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:11:21.118893 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Getting quotas for user 4c7a6c1d08554db09d65394ec338f8b5 and project 34b812a3f98747eeac35fbc27a342ab0. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:11:21.127678 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:11:21.129768 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d8d144dc-7058-4ad0-8e36-7de0284ca5ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:11:21.130441 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:11:21.133317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:11:21.202648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-faed9846-6935-4d52-bcec-9bc959275ec2 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258540 Aug 08 18:11:21.203501 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 159/330] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:11:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 18:11:21.208120 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:21.208756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:21.214946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.215431 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.215865 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.216638 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.217068 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.217450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.226919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f6a12b4d-407a-41df-955b-42ddccaf7964 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.367708 Aug 08 18:11:21.228375 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 172/331] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:11:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:11:21.234393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:21.235186 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:21.237906 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:21.245281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.246160 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.246745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.247876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.251120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.251120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.453342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:21.457192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:21.462154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:21.463661 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:21.475194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1f3cfc5f-ae6c-46fc-b5cc-eb8d65e9edcb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.260752 Aug 08 18:11:21.475194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 160/332] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:21 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:21.475194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:21.475194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:21.475566 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ef82e972-c1ca-4af2-833e-2d7fa9495c11 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.243339 Aug 08 18:11:21.475566 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 173/333] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:21 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:21.479645 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:21.480261 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:21.486917 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.487545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.487985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.488712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.489168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.489758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.492439 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.497721 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.497721 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.497721 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:21.497721 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:21.498083 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:21.696697 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:21.701228 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:21.705717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a5475256-5410-4eb5-b614-e453ddf5a86f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.230315 Aug 08 18:11:21.708419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 174/334] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:21 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:21.711364 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ee31dd6a-a543-4e52-b97e-179b78f1716e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:21.711970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ee31dd6a-a543-4e52-b97e-179b78f1716e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:21.728389 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-84b92502-1cef-401a-8348-697796f9efab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.261682 Aug 08 18:11:21.736812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 161/335] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:21 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:21.740865 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd13f35c-c622-4b08-a3c7-b211b69adaa5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:21.742564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dd13f35c-c622-4b08-a3c7-b211b69adaa5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:21.778711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ee31dd6a-a543-4e52-b97e-179b78f1716e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:21.785512 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ee31dd6a-a543-4e52-b97e-179b78f1716e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1257 microversion: 2.1 time: 0.078267 Aug 08 18:11:21.786562 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 175/336] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:21 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1257 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:21.819016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dd13f35c-c622-4b08-a3c7-b211b69adaa5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:21.826863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dd13f35c-c622-4b08-a3c7-b211b69adaa5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1246 microversion: 2.1 time: 0.095848 Aug 08 18:11:21.827422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 162/337] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:21 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:22.330679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-f522b234-815f-4d1e-94f2-6cdafb0bc8ca req-b370b803-f44b-42bb-a927-419f9042fc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb281727-027c-4c38-99bb-09d9d1997425", "name": "network-vif-plugged", "status": "completed", "tag": "0b015091-eabe-4452-b3b7-8651bd39383a"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:22.343098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f522b234-815f-4d1e-94f2-6cdafb0bc8ca req-b370b803-f44b-42bb-a927-419f9042fc2d service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.343605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f522b234-815f-4d1e-94f2-6cdafb0bc8ca req-b370b803-f44b-42bb-a927-419f9042fc2d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.344252 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f522b234-815f-4d1e-94f2-6cdafb0bc8ca req-b370b803-f44b-42bb-a927-419f9042fc2d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.354404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-f522b234-815f-4d1e-94f2-6cdafb0bc8ca req-b370b803-f44b-42bb-a927-419f9042fc2d service nova] Creating event network-vif-plugged:0b015091-eabe-4452-b3b7-8651bd39383a for instance cb281727-027c-4c38-99bb-09d9d1997425 on hv-cinder-85236 Aug 08 18:11:22.359321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-f522b234-815f-4d1e-94f2-6cdafb0bc8ca req-b370b803-f44b-42bb-a927-419f9042fc2d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Aug 08 18:11:22.359902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 176/338] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:11:22.493650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:22.494914 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:22.498723 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:22.499949 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:22.509407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.510319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.510965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.512078 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.512778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.513574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.520708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.526239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.526239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.526239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.526239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.526616 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.740047 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:22.743707 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:22.751738 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8b4d7e8d-8257-4860-99fd-d306c26f403b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.260865 Aug 08 18:11:22.757351 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:22.759370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:22.760973 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7dd48d7c-323d-49e9-a79a-805ab6820979 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.274551 Aug 08 18:11:22.764301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 177/339] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:22 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:22.773138 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 163/340] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:22 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:22.778401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:22.779206 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:22.785939 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.789024 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:22.790210 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.790695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.791430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.792801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:22.797892 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.797892 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.807977 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.812098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.812098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.812098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:22.812098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:22.812730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:22.813028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:23.074257 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:23.081694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8e46318d-76c7-4ea8-9f78-e6a4051cff90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.307239 Aug 08 18:11:23.082264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 164/341] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:22 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:23.087410 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:23.088022 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:23.093879 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:23.094363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:23.096953 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:23.096953 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:23.096953 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:23.096953 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:23.100888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:23.108996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c79999d0-e602-4981-ba0c-7d0c4cb47b07 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.343307 Aug 08 18:11:23.109574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 178/342] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:22 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:23.114593 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:23.115443 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:23.122544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:23.123046 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:23.123856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:23.124580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:23.125204 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:23.127793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:23.178111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:23.186438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6113f489-e2cb-4b34-bc50-846368250b40 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1309 microversion: 2.1 time: 0.103180 Aug 08 18:11:23.187073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 165/343] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:23 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:23.208842 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:23.216640 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a0f7e67f-22cf-4e2b-9d34-8f7a1408c729 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1298 microversion: 2.1 time: 0.105880 Aug 08 18:11:23.217230 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 179/344] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:23 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:23.778452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:23.779152 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:23.785027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:23.785661 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:23.787418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:23.788014 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:23.789108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:23.789985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:23.790537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:23.791295 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:23.796660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:23.797154 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:23.797706 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:23.799350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:23.799350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:23.799350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.000443 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:24.001568 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:24.010109 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:24.010540 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f910881b-35d9-45f3-a9be-b752b944dac2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.236055 Aug 08 18:11:24.011195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 166/345] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:23 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:24.021828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:24.021828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-51988010-45b1-4da3-9a48-265d8b7e5957 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.232482 Aug 08 18:11:24.021828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 180/346] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:23 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:24.102977 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:24.103608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:24.109726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:24.110212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:24.110945 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.111655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:24.112109 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:24.112554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.129787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:24.133797 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:24.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:24.139094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:24.139762 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.140561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:24.141196 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:24.141630 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.328694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:24.333933 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:24.339450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b729466f-9f25-46cf-a334-7c7ba0d5c005 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1367 microversion: 2.1 time: 0.238363 Aug 08 18:11:24.339450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 167/347] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:24 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:24.342279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7cfcdac6-e5b0-4992-968d-3b1d09f48a15 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.217125 Aug 08 18:11:24.347780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:24.347780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:24.350645 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 181/348] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:24 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:24.358538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:24.359159 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:24.359567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:24.359703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:24.361147 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.362131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:24.362676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:24.363184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.365870 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:24.367119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:24.367448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.368145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:24.368667 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:24.369215 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:24.435550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:24.437944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:24.444095 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b2b39360-4e6e-4285-9ead-3200ff80bfbc tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1306 microversion: 2.1 time: 0.091725 Aug 08 18:11:24.445408 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 182/349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:24 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:24.463658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:24.484387 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f4e9df8e-b2b6-4954-873a-e202dfc45619 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1309 microversion: 2.1 time: 0.145114 Aug 08 18:11:24.485509 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 168/350] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:24 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:25.031406 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:25.032060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:25.036119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:25.037395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:25.039763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.040250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.040729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.041430 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.041881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.042300 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.045002 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.045550 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.046051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.046998 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.047641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.048186 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.237575 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:25.240409 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:25.247073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ec6df00b-d162-413f-8169-60ef7be1f8a2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.219560 Aug 08 18:11:25.247655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 183/351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:25 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:25.249190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:25.250687 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:25.251857 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-962315fa-dc55-42dc-a0e8-2b02ebc37ac7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.220491 Aug 08 18:11:25.252685 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 169/352] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:25 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:25.359374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:25.359948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:25.363580 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:25.364194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:25.366210 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.367298 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.367845 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.368564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.369020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.369441 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.370882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.371357 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.371825 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.372645 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.373097 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.373510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.576545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:25.586548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-797aaac2-d179-497d-98e4-7733f2e4e685 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1558 microversion: 2.1 time: 0.231266 Aug 08 18:11:25.588251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 184/353] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:25 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:25.599079 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:25.612006 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:25.613037 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:25.616720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-56eb6b29-571b-49a7-a194-c07f2dfe9e48 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.256477 Aug 08 18:11:25.618297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 170/354] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:25 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:25.628538 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:25.630040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:25.636798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.637552 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.638176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.639220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.639840 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.640428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.652265 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.654144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.655381 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.659087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.659087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.659874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.731215 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:25.739507 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e1ca2ea7-3ff1-4003-b0c5-921db4677609 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1316 microversion: 2.1 time: 0.138661 Aug 08 18:11:25.740077 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 185/355] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:25 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1316 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:25.744814 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:25.745478 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:25.751404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.752126 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.752779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.753700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:25.754371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:25.755021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:25.807106 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:25.821517 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e83617f4-a20c-4f50-bef0-9199e69e3ca4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1317 microversion: 2.1 time: 0.201411 Aug 08 18:11:25.822394 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 171/356] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:25 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:25.883395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-52389d2d-2d68-44cf-aee9-a933663ff27b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140788 Aug 08 18:11:25.889146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 186/357] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 18:11:25 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:26.267571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:26.268909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:26.275580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:26.276444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:26.277011 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:26.277150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:26.277582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:26.278540 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:26.279213 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:26.279862 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:26.287206 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:26.287789 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:26.288852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:26.289735 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:26.290201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:26.290201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:26.653779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:26.665013 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:26.666530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:26.667717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-77f0c2a4-1493-49aa-9cc2-b714f81c7aa3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.397244 Aug 08 18:11:26.668282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 187/358] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:26 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:26.680529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:26.691697 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:26.691697 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:26.692302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-64d5af99-4bd4-4de6-b73b-5d8f79c911d5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.427875 Aug 08 18:11:26.694070 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 172/359] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:26 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:26.715303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:26.715303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:26.715303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:26.715303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:26.715605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:26.715680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:26.784684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:26.785690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:26.813692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:26.813692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:26.813692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:26.814037 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:26.814237 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:26.814671 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:27.003121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:27.013353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7dde73b8-4165-40d3-9a12-a531fdd7ebad tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.336383 Aug 08 18:11:27.015259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 188/360] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:26 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:27.020990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:27.021863 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:27.047259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:27.049031 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:27.049581 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:27.050347 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:27.052247 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:27.052247 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:27.081154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:27.089100 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e03e252-f76e-4322-919f-023a9578cb8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.308683 Aug 08 18:11:27.089805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 173/361] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:26 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:27.130081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:27.138985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e29a0105-0627-4cff-94bc-22eded131912 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1315 microversion: 2.1 time: 0.121917 Aug 08 18:11:27.139810 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 189/362] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:27 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1315 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:27.695650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-cc1e7e6f-ad60-4d6f-a830-e23bbcac17c6 req-d8ecb8a0-d92f-48f9-bd00-c5fe1588cd39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb281727-027c-4c38-99bb-09d9d1997425", "tag": "0b015091-eabe-4452-b3b7-8651bd39383a"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:27.700050 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:27.700759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:27.706539 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cc1e7e6f-ad60-4d6f-a830-e23bbcac17c6 req-d8ecb8a0-d92f-48f9-bd00-c5fe1588cd39 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:27.707100 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cc1e7e6f-ad60-4d6f-a830-e23bbcac17c6 req-d8ecb8a0-d92f-48f9-bd00-c5fe1588cd39 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:27.707250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:27.707635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cc1e7e6f-ad60-4d6f-a830-e23bbcac17c6 req-d8ecb8a0-d92f-48f9-bd00-c5fe1588cd39 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:27.707742 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:27.708157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:27.709022 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:27.709793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:27.710370 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:27.719562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-cc1e7e6f-ad60-4d6f-a830-e23bbcac17c6 req-d8ecb8a0-d92f-48f9-bd00-c5fe1588cd39 service nova] Creating event network-changed:0b015091-eabe-4452-b3b7-8651bd39383a for instance cb281727-027c-4c38-99bb-09d9d1997425 on hv-cinder-85236 Aug 08 18:11:27.724801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-cc1e7e6f-ad60-4d6f-a830-e23bbcac17c6 req-d8ecb8a0-d92f-48f9-bd00-c5fe1588cd39 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034678 Aug 08 18:11:27.725478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 174/363] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:27.731668 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:27.732446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:27.739032 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:27.739602 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:27.740111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:27.740934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:27.741965 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:27.742474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:27.912332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:27.930820 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:27.939321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:27.939583 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dcf02c11-d8db-4ff0-84db-af016acc12c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.212484 Aug 08 18:11:27.940086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 175/364] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:27 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:27.942196 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:27.955831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c1f614d2-53f6-439a-88ee-de3a91d2769f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.259741 Aug 08 18:11:27.977625 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 190/365] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:27 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:28.037827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:28.037827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:28.045139 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.045650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:28.046065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:28.046774 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.047237 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:28.047634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:28.113254 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:28.114166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:28.123975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.130270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:28.130270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:28.130961 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.131481 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:28.132546 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:28.268012 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:28.277272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-55f94a49-be09-4a16-ac5d-1f781b9cfeef tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.245864 Aug 08 18:11:28.278700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 176/366] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:28 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:28.301659 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:28.303644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:28.312141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.313025 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:28.313890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:28.314851 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.315503 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:28.316319 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:28.427444 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:28.437594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-83c707e6-4480-424f-b155-23688270b9d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.328705 Aug 08 18:11:28.441569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 191/367] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:28 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:28.603002 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:28.617375 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-41801c08-fa37-4b98-802a-aa27c5bc8a34 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.336245 Aug 08 18:11:28.618225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 177/368] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:28 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:28.966788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:28.967399 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:28.981629 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.982326 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:28.985780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:28.985780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.985780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:28.985780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:28.987050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:28.987748 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:28.999016 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:28.999834 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:29.000452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:29.001418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:29.002787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:29.003425 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:29.400637 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:29.409719 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:29.415585 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:29.417735 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3ae85bc8-0f53-4c80-93a1-9703c27dd78c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.437061 Aug 08 18:11:29.419186 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 178/369] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:28 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:29.426277 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:29.429937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:29.433242 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:29.435892 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9e064af1-7497-43d6-acb3-70e002ae63bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.473126 Aug 08 18:11:29.448634 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 192/370] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:28 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:29.449233 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:29.449735 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:29.449812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:29.453831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:29.454564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:29.455164 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:29.463851 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:29.465209 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:29.481096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:29.484608 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:29.485288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:29.486316 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:29.487177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:29.487831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:29.767909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:29.781464 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e37bbdb5-d973-46d0-b209-841609e2f5ea tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.361004 Aug 08 18:11:29.782693 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 179/371] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:29 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:29.799540 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:29.800349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:29.816707 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:29.817544 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:29.818208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:29.819159 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:29.819899 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:29.820562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:29.834983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:29.854694 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ec0ec37f-1aa3-4619-844e-34d3397d18f8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.395154 Aug 08 18:11:29.858704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 193/372] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:29 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:30.037661 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:30.047706 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-42adc112-92e3-4d65-bb35-45730d3df16c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.263713 Aug 08 18:11:30.048280 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 180/373] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:29 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:30.442129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:30.442740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:30.450185 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.450682 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.451127 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:30.452266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.453017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.453600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:30.463260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-4ea06ae0-15b4-4e97-a22a-b644ad079258 req-c3e86fbe-4b82-4221-a6e3-4c5f8f39c735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c18185-5443-4967-832b-8cec6d6aa044", "name": "network-vif-plugged", "status": "completed", "tag": "364cbc31-b2c9-4de9-a7cd-715d07c15ee5"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:30.482523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4ea06ae0-15b4-4e97-a22a-b644ad079258 req-c3e86fbe-4b82-4221-a6e3-4c5f8f39c735 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.483234 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4ea06ae0-15b4-4e97-a22a-b644ad079258 req-c3e86fbe-4b82-4221-a6e3-4c5f8f39c735 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.484589 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4ea06ae0-15b4-4e97-a22a-b644ad079258 req-c3e86fbe-4b82-4221-a6e3-4c5f8f39c735 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:30.498758 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-4ea06ae0-15b4-4e97-a22a-b644ad079258 req-c3e86fbe-4b82-4221-a6e3-4c5f8f39c735 service nova] Creating event network-vif-plugged:364cbc31-b2c9-4de9-a7cd-715d07c15ee5 for instance 87c18185-5443-4967-832b-8cec6d6aa044 on hv-cinder-85236 Aug 08 18:11:30.504618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-4ea06ae0-15b4-4e97-a22a-b644ad079258 req-c3e86fbe-4b82-4221-a6e3-4c5f8f39c735 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050975 Aug 08 18:11:30.505853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 181/374] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:30.517589 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:30.521879 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:30.526267 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.527158 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.527768 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:30.529932 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.530657 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.531258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:30.537131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:30.826747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:30.836480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:30.842453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:30.843965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:30.845176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ed998b22-13ac-4959-8790-c5ccf8633865 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.407138 Aug 08 18:11:30.845740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 194/375] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:30 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:30.854579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4de92997-4fd4-437e-9fb7-8ef753eede25 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.346522 Aug 08 18:11:30.857671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:30.857931 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 182/376] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:30 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:30.858704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:30.879121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:30.879732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:30.884141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.886608 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.887209 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:30.888076 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.889984 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.890662 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.891252 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:30.896386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.897092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:30.898561 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:30.899144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:30.899667 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:31.103460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:31.104898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:31.124243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:31.132454 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cb70745d-a6c8-4430-92e6-f0bdb553746f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.285645 Aug 08 18:11:31.137764 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 195/377] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:30 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:31.140168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:31.140911 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:31.146805 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:31.147338 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:31.147773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:31.148466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:31.148946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:31.149383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:31.168181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:31.179720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9d44d729-67e8-431a-b9ad-45417df46d2b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.303016 Aug 08 18:11:31.181284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 183/378] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:30 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:31.346374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:31.355684 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cb1ecc34-5cbc-478d-b13b-4313093bc958 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.220904 Aug 08 18:11:31.356649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 196/379] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:31 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:31.869827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:31.871141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:31.873487 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=32 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:31.875286 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:31.875965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:31.879090 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:31.879506 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=8 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:31.880722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:31.880722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:31.880915 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:31.881428 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:31.881985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:31.883180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:31.883861 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:31.884606 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:31.885302 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:31.885752 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:31.886170 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:32.095464 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:32.099643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:32.104819 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9ed0c708-ea0e-4009-b7f4-fee27a57d8fe tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.233234 Aug 08 18:11:32.105398 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 197/380] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:31 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:32.108468 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:32.110005 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:32.111182 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ed119aaa-a6bb-49ec-9fcf-9d611b183633 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.246403 Aug 08 18:11:32.111733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 184/381] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:31 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:32.154465 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:32.155130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:32.161362 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:32.161836 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:32.162296 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:32.163037 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:32.163492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:32.163910 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:32.204632 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:32.205799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:32.214942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:32.215677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:32.216363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:32.217349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:32.218393 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:32.219068 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:32.626895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:32.645881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6432336c-8880-44f3-87a6-7fe3f73327c4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.495405 Aug 08 18:11:32.646482 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 198/382] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:32 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:32.668762 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:32.668762 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:32.669008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:32.677462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-aca407de-9eea-432f-ba30-c3000b559e42 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.478765 Aug 08 18:11:32.680557 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 185/383] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:32 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:32.701412 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:32.701920 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:32.702357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:32.703074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:32.705060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:32.705841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:32.849849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-3307b257-a6b5-449c-981b-da2d4cd6914e req-2fcd8ba9-8e4c-4a84-8f2e-b92516c573e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d", "name": "network-vif-plugged", "status": "completed", "tag": "ba2a15cb-dff8-4775-9544-c1155b4411cf"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:32.860051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-3307b257-a6b5-449c-981b-da2d4cd6914e req-2fcd8ba9-8e4c-4a84-8f2e-b92516c573e0 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:32.860557 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-3307b257-a6b5-449c-981b-da2d4cd6914e req-2fcd8ba9-8e4c-4a84-8f2e-b92516c573e0 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:32.869338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-3307b257-a6b5-449c-981b-da2d4cd6914e req-2fcd8ba9-8e4c-4a84-8f2e-b92516c573e0 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:32.878405 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-3307b257-a6b5-449c-981b-da2d4cd6914e req-2fcd8ba9-8e4c-4a84-8f2e-b92516c573e0 service nova] Creating event network-vif-plugged:ba2a15cb-dff8-4775-9544-c1155b4411cf for instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d on hv-cinder-85236 Aug 08 18:11:32.884379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-3307b257-a6b5-449c-981b-da2d4cd6914e req-2fcd8ba9-8e4c-4a84-8f2e-b92516c573e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037921 Aug 08 18:11:32.885203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 186/384] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:11:32.887228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:32.890887 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:32.895911 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1b593e5f-0672-466f-82d5-28614e440cfe tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.241401 Aug 08 18:11:32.899141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 199/385] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:32 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:33.127681 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:33.129307 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:33.132936 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:33.135713 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:33.136559 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:33.140154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.140964 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.141621 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.142571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.143242 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.143876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.160906 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.161397 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.161839 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.162589 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.163092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.166709 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.427816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:33.437327 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-eafe8cf5-c359-43f1-b864-4914ae8b7e90 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.315703 Aug 08 18:11:33.441053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 187/386] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:33 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:33.442148 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:33.451451 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:33.453840 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:33.455531 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fd88fbf9-4e41-4685-8ca1-bcce021bee29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.325418 Aug 08 18:11:33.459714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 200/387] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:33 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:33.667678 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:33.668423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:33.674543 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.675028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.675512 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.676164 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.676653 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.677082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.706487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:33.706487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:33.712229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.712761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.713223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.713893 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.714348 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.714775 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.945233 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:33.949624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:33.952861 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-538fd7d4-602f-4acd-8016-b3f9444c01d3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.290033 Aug 08 18:11:33.966143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 188/388] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:33 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:33.966143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:33.966143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:33.969558 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.970579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.971251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:33.972201 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:33.972751 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2a4cc5d7-c618-4051-b019-cb11d75f3ed3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.271097 Aug 08 18:11:33.973111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:33.973650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 201/389] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:33 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:33.973779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:34.135731 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:34.146308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d62ddc2b-ad6c-4246-a1c2-e35d6b44b554 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.189618 Aug 08 18:11:34.146308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 189/390] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:33 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:34.459457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:34.460059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:34.468543 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:34.469108 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:34.469926 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:34.470768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:34.471469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:34.472226 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:34.483983 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:34.484593 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:34.505471 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:34.507256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:34.507515 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:34.508381 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:34.508906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:34.509327 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:34.726959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:34.738934 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-037481ef-1253-4e17-8350-fc8c8016f8ae tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.283335 Aug 08 18:11:34.752149 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 202/391] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:34 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:34.759744 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:34.769310 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:34.770941 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:34.772897 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4a0c3a42-ec78-45a5-b60d-16ba62f87314 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.293089 Aug 08 18:11:34.773458 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 190/392] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:34 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:34.973734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:34.974304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:34.984370 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:34.985387 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:34.985987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:34.986860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:34.987618 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:34.988358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:35.008907 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:35.009533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:35.016261 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:35.016783 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:35.017545 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:35.018510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:35.019277 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:35.019713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:35.200268 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:35.209708 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ab357cd7-922c-4837-a659-6240f1049672 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.239836 Aug 08 18:11:35.214585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 203/393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:34 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:35.219646 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:35.220323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:35.226771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:35.227266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:35.227705 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:35.228420 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:35.228904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:35.229323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:35.233096 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:35.242757 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b9009202-c879-4b28-a74f-2583e5b44cb5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.243185 Aug 08 18:11:35.243884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 191/394] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:34 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:35.373531 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:35.381354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-25476f32-86f9-4d7b-af6f-dde5f2ebad7e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.165654 Aug 08 18:11:35.382316 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 204/395] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:35 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:35.762296 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:35.762916 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:35.769623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:35.770119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:35.770772 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:35.771837 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:35.772893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:35.773354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:35.797213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:35.798151 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:35.806375 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:35.807178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:35.807802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:35.808760 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:35.809461 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:35.809974 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:36.032751 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:36.033478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:36.045387 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:36.045855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b0fb6e18-ca4e-446b-856e-75a93f6b7d57 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.287653 Aug 08 18:11:36.048314 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 192/396] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:35 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:36.048465 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:36.048624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9645eb5a-07c7-426f-b7bd-c954e51444d8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.255460 Aug 08 18:11:36.049336 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 205/397] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:35 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:36.231628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:36.232537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:36.239102 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:36.239958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:36.240184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:36.241543 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:36.242093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:36.242587 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:36.263868 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:36.265113 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:36.271453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:36.271942 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:36.272409 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:36.273156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:36.273615 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:36.274039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:36.455686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:36.460519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:36.463953 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-77b60d07-17ed-4d28-bba9-e03239eb1d12 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.236140 Aug 08 18:11:36.464631 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 193/398] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:36 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:36.477307 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5ad95adf-0095-4097-915f-9ada26276f8d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.217314 Aug 08 18:11:36.477943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 206/399] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:36 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:36.479178 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:36.479795 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:36.486059 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:36.486543 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:36.486992 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:36.487696 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:36.488140 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:36.488587 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:36.625774 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:36.634311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-eb5eef3c-a278-4a69-a73b-3efac420c850 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.159454 Aug 08 18:11:36.635071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 194/400] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:36 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:37.068563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:37.069227 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:37.071080 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:37.071696 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:37.075870 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.079131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.079131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.079131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.079417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.079506 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.079588 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.079677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.079752 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.079752 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.080101 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.080559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.298755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:37.309203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-22e7bb0a-aad2-4695-a2e6-68fd35986a04 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1725 microversion: 2.1 time: 0.244355 Aug 08 18:11:37.312556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 207/401] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:37 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:37.333006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:37.346061 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:37.346061 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:37.346061 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e2d61dbf-b021-4fa3-8000-9e6e882c0f7d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1745 microversion: 2.20 time: 0.278092 Aug 08 18:11:37.346597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 195/402] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:37 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1745 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:37.484497 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:37.485169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:37.492326 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.493169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.500831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.500831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.501017 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:37.501017 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:37.503421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.503941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.508672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.509175 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.509724 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.510537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.511000 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.511429 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.822646 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:37.839267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d64fb345-3cf3-44c1-ac59-59ef8c9c4bcc tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.357201 Aug 08 18:11:37.843768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 208/403] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:37 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:37.851747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:37.855147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:37.872170 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.872444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:37.872768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.872768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.872768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:37.872768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:37.877972 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-acd96de3-a4be-482d-91b9-7a6a38a8d989 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.381743 Aug 08 18:11:37.878419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:37.880665 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 196/404] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:37 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:38.039241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-77a16a26-46b5-49ca-a105-cc51f94a11e7 req-a2fcdef1-0116-4994-80f6-f64f91e416ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc0adbbe-a03d-4b75-99d2-5a8f9c36567b", "tag": "d266e64e-9c90-4916-b8ce-ab1d6acfc3fe"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:38.067900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-77a16a26-46b5-49ca-a105-cc51f94a11e7 req-a2fcdef1-0116-4994-80f6-f64f91e416ed service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.070269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-77a16a26-46b5-49ca-a105-cc51f94a11e7 req-a2fcdef1-0116-4994-80f6-f64f91e416ed service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.070925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-77a16a26-46b5-49ca-a105-cc51f94a11e7 req-a2fcdef1-0116-4994-80f6-f64f91e416ed service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.096265 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-77a16a26-46b5-49ca-a105-cc51f94a11e7 req-a2fcdef1-0116-4994-80f6-f64f91e416ed service nova] Creating event network-changed:d266e64e-9c90-4916-b8ce-ab1d6acfc3fe for instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b on hv-cinder-85236 Aug 08 18:11:38.102878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-77a16a26-46b5-49ca-a105-cc51f94a11e7 req-a2fcdef1-0116-4994-80f6-f64f91e416ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067564 Aug 08 18:11:38.104154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 197/405] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:11:38.173671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:38.182168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4aa2561d-0f1d-43fd-90c0-3427637955da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.337005 Aug 08 18:11:38.182745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 209/406] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:37 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:38.332125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:38.333134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:38.340388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.340975 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.341495 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.342262 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.342754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.343184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.367951 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:38.368701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:38.374691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.375241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.375748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.376555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.377169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.377592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.690498 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:38.699181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c045a4fe-b964-4331-bef9-064aa5aecfd1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1702 microversion: 2.1 time: 0.371673 Aug 08 18:11:38.711193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 198/407] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:38 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1702 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:38.711193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-4e4fa3c1-264f-455d-9b68-60d754eab73b req-883e5cb8-a5d0-419b-83ce-1f05e2af6adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3a285c-f9d9-4be0-b67e-94e7a7eee516", "tag": "304be941-82c9-4c43-a117-34baa084b8dd"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:38.714625 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:38.721359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4e4fa3c1-264f-455d-9b68-60d754eab73b req-883e5cb8-a5d0-419b-83ce-1f05e2af6adc service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.721576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4e4fa3c1-264f-455d-9b68-60d754eab73b req-883e5cb8-a5d0-419b-83ce-1f05e2af6adc service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.722197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4e4fa3c1-264f-455d-9b68-60d754eab73b req-883e5cb8-a5d0-419b-83ce-1f05e2af6adc service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.731888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:38.733883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:38.734787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-eaa87a5b-57ba-4845-8d73-8e88c4f4e106 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.370917 Aug 08 18:11:38.735570 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 210/408] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:38 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:38.736873 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-4e4fa3c1-264f-455d-9b68-60d754eab73b req-883e5cb8-a5d0-419b-83ce-1f05e2af6adc service nova] Creating event network-changed:304be941-82c9-4c43-a117-34baa084b8dd for instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 on hv-cinder-85236 Aug 08 18:11:38.742621 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-4e4fa3c1-264f-455d-9b68-60d754eab73b req-883e5cb8-a5d0-419b-83ce-1f05e2af6adc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041183 Aug 08 18:11:38.743849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 199/409] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:38.748332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0c6a4a1e-051c-4a90-8310-4351fd51b707 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:38.758378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c6a4a1e-051c-4a90-8310-4351fd51b707 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.758378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c6a4a1e-051c-4a90-8310-4351fd51b707 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.758378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0c6a4a1e-051c-4a90-8310-4351fd51b707 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.779254 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0c6a4a1e-051c-4a90-8310-4351fd51b707 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Going to try to start instance {{(pid=118382) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 18:11:38.863636 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:38.864353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:38.870693 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.871166 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.871589 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.872270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.872793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.873254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.953597 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0c6a4a1e-051c-4a90-8310-4351fd51b707 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/action" status: 202 len: 0 microversion: 2.1 time: 0.216988 Aug 08 18:11:38.954643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 211/410] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:11:38 2022] POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:11:38.960544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:38.961276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:38.967616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.968330 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.968883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:38.969576 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:38.970033 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:38.970456 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:39.030309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:39.033960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:39.044822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cc4f40ec-9aee-4fd7-9f84-e5f7afda84d0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1258 microversion: 2.1 time: 0.179237 Aug 08 18:11:39.044822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 200/411] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:38 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:39.048522 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:39.049383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:39.057222 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:39.057815 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:39.058447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:39.059338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:39.059956 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:39.060577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:39.274390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:39.282782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f50c02ba-ed21-4945-bd12-172ab1cce109 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.326600 Aug 08 18:11:39.283643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 212/412] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:38 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:39.291565 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:39.292565 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:39.299449 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:39.300024 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:39.300542 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:39.301637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:39.302087 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:39.302503 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:39.830004 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:39.846119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c7665264-ef76-40a3-8e22-6efc95f60bf3 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1711 microversion: 2.1 time: 0.805296 Aug 08 18:11:39.847819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 201/413] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:39 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1711 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:39.854323 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:39.856083 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:39.867683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:39.868655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:39.870193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:39.871285 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:39.871972 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:39.872684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:40.012054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:40.027642 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-438431d7-011a-44db-9992-207f0388ce57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.742537 Aug 08 18:11:40.034276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 213/414] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:39 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:40.065739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:40.066578 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:40.082998 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:40.083432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:40.083880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:40.084643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:40.085104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:40.089041 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:40.101434 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:40.110031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:40.113811 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:40.115165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-081cc0dd-5336-4698-88a9-4ff8246f9780 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.266020 Aug 08 18:11:40.116850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 202/415] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:39 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:40.306328 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:40.312359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:40.321371 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:40.322227 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:40.322910 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:40.324111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:40.325720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:40.330294 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:40.674304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:40.686845 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-13e65523-c4a6-4831-b6b9-f74147408ce9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1443 microversion: 2.1 time: 0.629874 Aug 08 18:11:40.704147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 214/416] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:40 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1443 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:40.720418 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:40.722336 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:40.736233 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:40.736766 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:40.737376 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:40.738272 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:40.738886 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:40.739478 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:40.802185 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:40.894948 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:40.906600 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b6520c01-ca30-4f44-b649-9a4be9e84cac tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.604631 Aug 08 18:11:40.912788 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 203/417] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:40 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:40.916922 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:40.932027 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:40.940261 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:40.945225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:40.945225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:40.945225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:40.945225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:40.945581 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:41.287283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:41.299090 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-84c490c0-a280-4147-8048-46ecef45ae35 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1443 microversion: 2.1 time: 0.593116 Aug 08 18:11:41.300107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 215/418] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:40 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1443 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:41.308780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:41.310321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:41.318025 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:41.318350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:41.319142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:41.319752 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:41.321301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:41.321950 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:41.322707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:41.334069 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-edbc07f4-877d-453e-a4cd-19a0a492d60b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1711 microversion: 2.1 time: 0.421349 Aug 08 18:11:41.334873 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 204/419] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:40 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1711 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:41.341095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:41.341879 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:41.350336 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:41.351135 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:41.351851 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:41.352921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:41.353461 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:41.353944 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:41.664783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:41.682902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2143b2f6-99bb-4cd4-8cfe-e83f8764e8c9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.381304 Aug 08 18:11:41.684708 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 216/420] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:41 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:41.769239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:41.778666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:41.783761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:41.785249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9a7790f1-896f-4ccf-a359-9731b89703e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.449372 Aug 08 18:11:41.786241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 205/421] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:41 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:41.933187 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:41.934010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:41.942276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:41.950922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:41.950922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:41.950922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:41.950922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:41.951290 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:42.194598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:42.208902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ec2c1838-1097-4773-822c-02fe5a492ef1 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.280732 Aug 08 18:11:42.210131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 217/422] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:41 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:42.357205 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:42.361833 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:42.370573 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:42.372086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:42.372706 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:42.373611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:42.378895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:42.379716 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:42.556133 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:42.564447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ff1fc88d-d646-4250-bc41-4b626f5bbec5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1715 microversion: 2.1 time: 0.212411 Aug 08 18:11:42.565405 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 206/423] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:42 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1715 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:42.707005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:42.708429 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:42.719768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:42.720257 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:42.723012 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:42.723788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:42.724263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:42.724768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:42.810670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:42.811373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:42.818336 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:42.819802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:42.819802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:42.820185 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:42.822263 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:42.822812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:42.967193 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:42.977188 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-506826bd-6b12-4954-a747-76037b4e550d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.274840 Aug 08 18:11:42.981232 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 218/424] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:42 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:43.043124 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:43.052601 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:43.065475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:43.065475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-144df765-b9e5-4e7a-9647-cdc6ee683431 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.249243 Aug 08 18:11:43.065475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 207/425] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:42 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:43.231928 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:43.232567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:43.242192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:43.242688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:43.243124 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:43.243832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:43.244283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:43.244748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:43.396203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:43.410507 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7f6b9dff-1fd9-4122-a8da-06260d002c34 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.182359 Aug 08 18:11:43.411081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 219/426] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:43 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:44.003961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:44.004668 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:44.012030 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:44.012664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:44.014051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:44.014993 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:44.015939 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:44.016607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:44.104848 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:44.105686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:44.123740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:44.123740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:44.123740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:44.123740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:44.124741 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:44.124741 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:44.249065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:44.264025 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-96ae1468-0d49-4881-a807-6eb86bd8cb9e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.264061 Aug 08 18:11:44.282056 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 208/427] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:43 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:44.347302 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:44.357357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:44.358967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:44.360223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c8a9f83b-89b6-4ebf-8d5b-ff7f6ca6b230 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.262554 Aug 08 18:11:44.376771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 220/428] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:44 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:44.431684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:44.432601 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:44.440862 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:44.445055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:44.445623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:44.446471 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:44.447061 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:44.450244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:44.469428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-e6702750-9364-4e38-9a11-316e5d070dd5 req-3ff8a8c4-872d-4baf-9321-a2862b13a46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d", "tag": "ba2a15cb-dff8-4775-9544-c1155b4411cf"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:44.488675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e6702750-9364-4e38-9a11-316e5d070dd5 req-3ff8a8c4-872d-4baf-9321-a2862b13a46a service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:44.489280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e6702750-9364-4e38-9a11-316e5d070dd5 req-3ff8a8c4-872d-4baf-9321-a2862b13a46a service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:44.489777 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e6702750-9364-4e38-9a11-316e5d070dd5 req-3ff8a8c4-872d-4baf-9321-a2862b13a46a service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:44.526279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-e6702750-9364-4e38-9a11-316e5d070dd5 req-3ff8a8c4-872d-4baf-9321-a2862b13a46a service nova] Creating event network-changed:ba2a15cb-dff8-4775-9544-c1155b4411cf for instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d on hv-cinder-85236 Aug 08 18:11:44.531666 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-e6702750-9364-4e38-9a11-316e5d070dd5 req-3ff8a8c4-872d-4baf-9321-a2862b13a46a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066095 Aug 08 18:11:44.532537 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 221/429] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:11:44.612978 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:44.621729 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c064b90f-59cb-43ba-b6ca-3c535cd10f6c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.194387 Aug 08 18:11:44.622489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 209/430] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:44 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:45.285927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:45.286880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:45.290062 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:45.302550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:45.306073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:45.306073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:45.306073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:45.306073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:45.306423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:45.385179 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:45.385799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:45.394726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:45.394726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:45.394726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:45.395158 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:45.395266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:45.395681 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:45.550484 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:45.560640 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c694eaf8-bcc1-4fcc-9410-11eb17f92876 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.277798 Aug 08 18:11:45.577282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 222/431] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:45 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:45.614972 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:45.627306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:45.628830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:45.630013 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ef4e9147-1661-4727-9ad6-e12ff2af7b8f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.249361 Aug 08 18:11:45.644250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:45.645355 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:45.649865 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 210/432] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:45 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:45.657511 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:45.658127 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:45.658570 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:45.659268 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:45.659773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:45.660308 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:45.825381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:45.833080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b2d7a333-63d8-4ef1-b7eb-419f9812b07b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.194125 Aug 08 18:11:45.833758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 223/433] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:45 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:46.583471 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:46.645635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:46.645635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:46.645635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:46.645635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:46.646338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:46.646338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:46.646338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:46.656097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:46.657545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:46.666452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:46.667007 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:46.667490 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:46.668289 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:46.669164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:46.669719 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:46.840666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:46.840666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-29bb5436-f873-4bca-8f21-b697ab0284ab tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.258180 Aug 08 18:11:46.840666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 211/434] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:46 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:46.855703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:46.856390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:46.862759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:46.863343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:46.863850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:46.864672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:46.865198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:46.866242 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:46.968402 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:46.977159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:46.978673 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:46.979993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-dfb1c626-02f3-4b40-b779-17ee4ff42c12 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.328767 Aug 08 18:11:46.980727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 224/435] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:46 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:47.072371 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:47.081305 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cffbaab0-a686-4cd2-aba1-51eb10a0a74c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.229320 Aug 08 18:11:47.085073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 212/436] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:46 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:47.858614 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:47.859931 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:47.866954 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:47.867893 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:47.869086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:47.870074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:47.870595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:47.871021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:48.009329 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:48.010746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:48.022274 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:48.022762 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:48.024740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:48.025500 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:48.026900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:48.029147 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:48.029602 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:48.036048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2ab781e2-f422-4f20-96de-759faeb0c2e0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.182571 Aug 08 18:11:48.049970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 225/437] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:47 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:48.103906 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:48.104734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:48.114123 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:48.116159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:48.116912 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:48.118421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:48.119592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:48.120352 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:48.222946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:48.231942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:48.236905 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:48.238339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c191a31e-a338-47f7-a1eb-8ab1756614fd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.232882 Aug 08 18:11:48.239393 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 213/438] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:48 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:48.352310 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:48.366020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-85f714cb-2b64-4c99-940d-21aca0254768 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.265711 Aug 08 18:11:48.367329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 226/439] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:48 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:49.063197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:49.063863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:49.071726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:49.072439 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:49.073086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:49.074249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:49.074710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:49.075145 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:49.228040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:49.236160 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b4e52e39-fb08-42e7-baaa-3063843437a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.178795 Aug 08 18:11:49.237005 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 214/440] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:49 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:49.263724 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:49.264332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:49.270905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:49.272756 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:49.273442 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:49.274367 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:49.275031 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:49.275662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:49.387913 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:49.389276 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:49.403186 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:49.405329 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:49.406581 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:49.408815 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:49.409560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:49.411105 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:49.434103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:49.444720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:49.449295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:49.450816 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-aa2f064e-376c-4a20-a019-5299b8c291f2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.190881 Aug 08 18:11:49.451520 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 227/441] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:49 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:49.647869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:49.650586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b8d030ec-0817-466a-85f1-e27e0465877a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.266652 Aug 08 18:11:49.651285 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 215/442] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:49 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:50.258569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:50.259117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:50.265139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:50.265765 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:50.266091 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:50.266778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:50.267234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:50.267659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:50.424485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:50.433697 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-be44bc6f-79cc-4553-99c5-f6fc09c86fee tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.179786 Aug 08 18:11:50.436842 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 228/443] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:50 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:50.476004 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:50.478470 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:50.486340 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:50.489742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:50.489742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:50.489742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:50.489742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:50.490194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:50.641243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:50.650157 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:50.652031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:50.653541 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8f161df7-b597-4411-9c98-4053a793986a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.182190 Aug 08 18:11:50.672216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:50.672216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:50.677611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 216/444] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:50 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:50.679283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:50.679766 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:50.680203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:50.681050 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:50.682214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:50.682647 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:50.849112 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:50.861919 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3bb2b8e7-c628-4924-9e09-9890aa8f8fd5 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.194022 Aug 08 18:11:50.867162 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 229/445] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:50 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:51.058222 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-62719b87-5ce1-4f34-9043-97309cc65624 req-0cd6411e-a541-4603-9b5f-58434f4f6a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc0adbbe-a03d-4b75-99d2-5a8f9c36567b", "name": "network-vif-plugged", "status": "completed", "tag": "d266e64e-9c90-4916-b8ce-ab1d6acfc3fe"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:51.072562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-62719b87-5ce1-4f34-9043-97309cc65624 req-0cd6411e-a541-4603-9b5f-58434f4f6a6b service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:51.072562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-62719b87-5ce1-4f34-9043-97309cc65624 req-0cd6411e-a541-4603-9b5f-58434f4f6a6b service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:51.072562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-62719b87-5ce1-4f34-9043-97309cc65624 req-0cd6411e-a541-4603-9b5f-58434f4f6a6b service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:51.080705 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-62719b87-5ce1-4f34-9043-97309cc65624 req-0cd6411e-a541-4603-9b5f-58434f4f6a6b service nova] Creating event network-vif-plugged:d266e64e-9c90-4916-b8ce-ab1d6acfc3fe for instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b on hv-cinder-85236 Aug 08 18:11:51.085977 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-62719b87-5ce1-4f34-9043-97309cc65624 req-0cd6411e-a541-4603-9b5f-58434f4f6a6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032123 Aug 08 18:11:51.086560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 217/446] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:51.454870 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:51.455458 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:51.464638 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:51.464638 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:51.464638 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:51.464638 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:51.464972 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:51.464972 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:51.628122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:51.636071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-562a5ee0-d859-4ab3-933e-759d909d1317 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.185399 Aug 08 18:11:51.636667 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 230/447] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:51 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:51.682653 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:51.683325 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:51.689450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:51.689936 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:51.690378 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:51.691219 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:51.691684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:51.692112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:51.703157 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:51.854830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:51.862713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:51.867999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:51.867999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e5d0a28-5faf-41dc-9a13-6d5dbcd8cbee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1740 microversion: 2.20 time: 0.188194 Aug 08 18:11:51.867999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 218/448] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:51 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:51.883057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:51.888030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:51.889601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:51.890098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:51.890506 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:51.891177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:51.891796 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:51.892213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:52.272475 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:52.279882 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-13f9da5b-3433-4bc1-8efc-538f872d369b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.400624 Aug 08 18:11:52.280457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 231/449] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:51 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:52.656820 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:52.657433 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:52.663523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:52.663999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:52.664436 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:52.665150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:52.665605 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:52.666027 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:52.794790 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:52.803344 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9b53e397-5d30-4a38-bf4b-58f480381b71 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1357 microversion: 2.1 time: 0.149677 Aug 08 18:11:52.804146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 219/450] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:52 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:52.888714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:52.889330 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:52.896317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:52.896839 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:52.897277 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:52.897988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:52.898447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:52.898868 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:53.036994 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:53.039769 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:11:53.046312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:53.047831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:53.049037 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cf5db638-bb1d-4f1a-93ad-945ee8a5747d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1722 microversion: 2.20 time: 0.164294 Aug 08 18:11:53.049601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 232/451] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:52 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:53.295708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-ea247a17-cb9c-48d3-be7e-4e109998061f req-aeb5b409-c88b-4efa-9a85-8636b1bc6e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3a285c-f9d9-4be0-b67e-94e7a7eee516", "name": "network-vif-plugged", "status": "completed", "tag": "304be941-82c9-4c43-a117-34baa084b8dd"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:53.300965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:53.301584 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:53.306300 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ea247a17-cb9c-48d3-be7e-4e109998061f req-aeb5b409-c88b-4efa-9a85-8636b1bc6e42 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:53.306778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ea247a17-cb9c-48d3-be7e-4e109998061f req-aeb5b409-c88b-4efa-9a85-8636b1bc6e42 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:53.307351 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ea247a17-cb9c-48d3-be7e-4e109998061f req-aeb5b409-c88b-4efa-9a85-8636b1bc6e42 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:53.308830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:53.309633 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:53.310094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:53.310789 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:53.311247 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:53.311740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:53.319571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-ea247a17-cb9c-48d3-be7e-4e109998061f req-aeb5b409-c88b-4efa-9a85-8636b1bc6e42 service nova] Creating event network-vif-plugged:304be941-82c9-4c43-a117-34baa084b8dd for instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 on hv-cinder-85236 Aug 08 18:11:53.325041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-ea247a17-cb9c-48d3-be7e-4e109998061f req-aeb5b409-c88b-4efa-9a85-8636b1bc6e42 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032915 Aug 08 18:11:53.325867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 220/452] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:11:53.452162 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:53.459644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5f12c554-470c-415c-b09b-13b4d49ce981 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.162979 Aug 08 18:11:53.460208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 233/453] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:53 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:53.824478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:53.825208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:53.831379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:53.831857 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:53.832292 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:53.833012 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:53.833465 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:53.833889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:53.966983 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:53.975625 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-98aa7d3e-a950-4d43-9d6d-3264b61a3ed6 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1547 microversion: 2.1 time: 0.155996 Aug 08 18:11:53.976190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 221/454] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:53 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:53.996208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:53.996865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:54.003279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.003763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.004200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.004947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.005401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.005856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.085154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:54.086056 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:54.092416 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.092937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.093376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.094081 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.094539 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.094970 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.210926 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:54.223727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5112ca52-bcdf-4487-9274-5f5c240f4c8c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1547 microversion: 2.1 time: 0.231250 Aug 08 18:11:54.231730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 234/455] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:53 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1547 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:54.245325 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:54.250156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:54.250933 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Searching by: {'deleted': False, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1'} {{(pid=118382) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 18:11:54.259657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.260579 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.261288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.262183 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.262833 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.263416 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.360562 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.multi_cell_list [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118382) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 18:11:54.360746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:54.374088 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:54.375794 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:54.377249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8edeca23-0a8a-4564-a747-53043b32965a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1722 microversion: 2.20 time: 0.297653 Aug 08 18:11:54.377909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 222/456] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:54 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:54.463165 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a142b321-5528-43d3-a2d9-4f2f869b166a tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.221762 Aug 08 18:11:54.464324 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 235/457] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Aug 8 18:11:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:11:54.477299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:54.478068 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:54.480345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:54.480999 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:54.487471 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.487685 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.487963 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.488746 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.488898 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.489450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.489573 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.489905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.490532 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.491417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:54.493252 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:54.494512 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:54.838615 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:54.846093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-51083835-1ab9-4e0a-9bd7-4d72683a838c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.369577 Aug 08 18:11:54.846778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 236/458] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:54 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:54.858558 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:54.869418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-304680d6-89d0-4ba0-9a15-64163caea31e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1547 microversion: 2.1 time: 0.397481 Aug 08 18:11:54.870525 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 223/459] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:54 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1547 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:55.401569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:55.402177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:55.408671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:55.409159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:55.409596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:55.410287 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:55.410775 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:55.411198 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:55.550944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:55.559104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:55.560744 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:55.561928 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0ab8732a-e28c-4067-a3e7-6b5b5e6f9c2b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1722 microversion: 2.20 time: 0.164275 Aug 08 18:11:55.562504 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 237/460] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:55 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:55.867346 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:55.867959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:55.875259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:55.875741 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:55.876206 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:55.876927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:55.877388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:55.877843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:56.010124 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:56.017502 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0b830d4a-083c-429e-a87d-d3047feda25b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.154145 Aug 08 18:11:56.018092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 224/461] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:55 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:11:56.584826 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:56.585445 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:56.591630 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:56.592101 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:56.592553 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:56.593231 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:56.593675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:56.594087 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:56.733615 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:56.743293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:56.745210 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:56.745765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b90f5f62-7eeb-435f-bb42-df5af73bb6a2"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:56.746578 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4529d6c4-ab84-46d9-ac60-e8f55fc4dee4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1722 microversion: 2.20 time: 0.165575 Aug 08 18:11:56.747210 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 238/462] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:56 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:56.748323 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:56.754643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:56.755124 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:56.755567 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:56.756254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:56.756763 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:56.757185 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:57.039912 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:57.040430 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:57.046273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:57.046831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:57.047190 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:57.047864 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:57.048335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:57.048781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:57.186020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:57.193809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bd1139f6-345b-4673-8d3e-2946ea1870f2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.158391 Aug 08 18:11:57.194656 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 239/463] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:57 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:57.214584 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-b2bcef59-1e90-4126-94b9-5a0851afaad3 req-f7307642-b9e3-4891-b958-74fc818e732f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c18185-5443-4967-832b-8cec6d6aa044", "name": "network-vif-unplugged", "status": "completed", "tag": "364cbc31-b2c9-4de9-a7cd-715d07c15ee5"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:57.224072 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-b2bcef59-1e90-4126-94b9-5a0851afaad3 req-f7307642-b9e3-4891-b958-74fc818e732f service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:57.224604 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-b2bcef59-1e90-4126-94b9-5a0851afaad3 req-f7307642-b9e3-4891-b958-74fc818e732f service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:57.225034 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-b2bcef59-1e90-4126-94b9-5a0851afaad3 req-f7307642-b9e3-4891-b958-74fc818e732f service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:57.236113 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-b2bcef59-1e90-4126-94b9-5a0851afaad3 req-f7307642-b9e3-4891-b958-74fc818e732f service nova] Creating event network-vif-unplugged:364cbc31-b2c9-4de9-a7cd-715d07c15ee5 for instance 87c18185-5443-4967-832b-8cec6d6aa044 on hv-cinder-85236 Aug 08 18:11:57.241214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-b2bcef59-1e90-4126-94b9-5a0851afaad3 req-f7307642-b9e3-4891-b958-74fc818e732f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030338 Aug 08 18:11:57.242758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 240/464] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:11:57.769802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:57.770501 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:57.776612 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:57.777094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:57.777532 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:57.778217 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:57.778669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:57.779090 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:57.914206 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:57.922453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:57.924314 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:57.925623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-61c36573-2b16-4668-9d18-ab5ef5470379 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1722 microversion: 2.20 time: 0.160529 Aug 08 18:11:57.926293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 241/465] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:57 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:11:58.221421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:58.222047 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:58.232315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:58.232844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:58.233344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:58.234104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:58.234561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:58.234991 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:58.369385 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:58.376880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a6ad1fd7-ee57-4cfd-84ba-8c47928da4db tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1371 microversion: 2.1 time: 0.165679 Aug 08 18:11:58.377468 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 242/466] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:58 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:58.935608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-45b98039-7717-462b-9ccd-de784a0ab742 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "POST /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.194295 Aug 08 18:11:58.936559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 225/467] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:11:56 2022] POST /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments => generated 194 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:11:58.949290 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:58.949810 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:58.956786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:58.957372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:58.957995 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:58.958870 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:58.959342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:58.959791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:59.093693 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:59.102173 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:59.103688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:59.104865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-73976339-5206-4588-ac82-9ddf00a455d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1725 microversion: 2.20 time: 0.160125 Aug 08 18:11:59.116009 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 243/468] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:11:58 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:11:59.128048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c9fc8d6-484a-4f93-9498-ed25dc5cab3d"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:11:59.130615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:59.137785 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:59.138257 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:59.138683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:59.139359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:59.139843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:59.140260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:59.398861 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:59.399789 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:59.405901 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:59.406376 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:59.406812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:59.407482 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:59.407922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:59.408363 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:59.549038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:11:59.556711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c5ca9088-4e7f-4efb-937a-2cb6f0614b9c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1565 microversion: 2.1 time: 0.162700 Aug 08 18:11:59.557277 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 244/469] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:11:59 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:11:59.577190 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:11:59.577701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:11:59.583642 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:59.584386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:59.584770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:59.585462 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:11:59.586523 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:11:59.586988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:11:59.670168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-929d97fa-06e2-4470-8f1f-97d1a3257caf tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096874 Aug 08 18:11:59.670777 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 245/470] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 18:11:59 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:12:00.148629 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a396eaf0-d16d-443a-987f-d0cc84ed6ca6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.024210 Aug 08 18:12:00.149576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 226/471] 10.222.0.50 () {62 vars in 1364 bytes} [Mon Aug 8 18:11:59 2022] POST /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments => generated 188 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:12:00.292767 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:00.293479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:00.299771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:00.302166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:00.302644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:00.303522 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:00.303830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:00.304258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:00.361640 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118382) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 18:12:00.700103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b795778c-f2da-464a-a50b-66573a3c14eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/action" status: 202 len: 0 microversion: 2.20 time: 0.413115 Aug 08 18:12:00.701071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 246/472] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Aug 8 18:12:00 2022] POST /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:12:00.709713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:00.710474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:00.719172 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:00.719172 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:00.719172 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:00.719610 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:00.720142 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:00.720820 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:00.726996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-4c3305c5-3ed3-46b7-aeab-a644d5075c07 req-66b02fb4-1430-4352-b7cb-76053b7665a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3a285c-f9d9-4be0-b67e-94e7a7eee516", "tag": "304be941-82c9-4c43-a117-34baa084b8dd"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:00.739222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-4c3305c5-3ed3-46b7-aeab-a644d5075c07 req-66b02fb4-1430-4352-b7cb-76053b7665a1 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:00.739980 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-4c3305c5-3ed3-46b7-aeab-a644d5075c07 req-66b02fb4-1430-4352-b7cb-76053b7665a1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:00.740591 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-4c3305c5-3ed3-46b7-aeab-a644d5075c07 req-66b02fb4-1430-4352-b7cb-76053b7665a1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:00.752748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-4c3305c5-3ed3-46b7-aeab-a644d5075c07 req-66b02fb4-1430-4352-b7cb-76053b7665a1 service nova] Creating event network-changed:304be941-82c9-4c43-a117-34baa084b8dd for instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 on hv-cinder-85236 Aug 08 18:12:00.758925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-4c3305c5-3ed3-46b7-aeab-a644d5075c07 req-66b02fb4-1430-4352-b7cb-76053b7665a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035529 Aug 08 18:12:00.759745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 247/473] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:12:00.911308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:00.921204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:00.922961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:00.924172 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9949cd52-8dac-4b14-9ad8-243a961eec16 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1751 microversion: 2.20 time: 0.219175 Aug 08 18:12:00.924959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 227/474] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:00 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:12:01.948855 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:01.949658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:01.956103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:01.956829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:01.957296 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:01.958065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:01.958750 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:01.959260 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:02.116392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:02.126122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:02.127739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:02.129082 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8edcea3c-eabd-4611-853b-6bd0159da340 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1751 microversion: 2.20 time: 0.185484 Aug 08 18:12:02.129729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 248/475] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:01 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:03.156496 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:03.157137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:03.163683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:03.164735 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:03.165176 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:03.165859 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:03.166311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:03.166730 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:03.303553 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:03.312057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:03.313584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:03.314745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-09c0550f-9714-4e40-9a73-6772863a5eb1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1753 microversion: 2.20 time: 0.162060 Aug 08 18:12:03.315300 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 228/476] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:03 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:04.344241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:04.344884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:04.347394 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:04.352256 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:04.355371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:04.355371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:04.355371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:04.355371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:04.355723 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:04.483771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:04.486124 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:04.493681 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:04.495220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:04.496396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-22ebbf5f-5d44-4f97-a119-3bf5e9d67ef5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1753 microversion: 2.20 time: 0.156214 Aug 08 18:12:04.496994 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 249/477] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:04 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:05.520933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:05.521885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:05.524313 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=84 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:05.528976 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:05.529471 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:05.529913 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:05.530617 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:05.531072 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:05.531501 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:05.662481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:05.671855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:05.673390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:05.674572 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6bcb5933-30b5-4813-8c25-778408a2f4eb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1753 microversion: 2.20 time: 0.157933 Aug 08 18:12:05.675121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 229/478] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:05 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:06.699026 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:06.699640 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:06.707146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:06.707644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:06.708122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:06.708866 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:06.709323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:06.709748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:06.848994 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:06.857482 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:06.858969 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:06.860136 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-def86850-1fa6-41ad-b455-8e2ca5211b60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1753 microversion: 2.20 time: 0.166956 Aug 08 18:12:06.860714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 250/479] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:06 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:07.883098 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:07.883749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:07.890173 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:07.890659 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:07.891099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:07.891799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:07.892256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:07.892712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:08.026521 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:08.034868 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:08.036364 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:08.037582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b78ce7e4-4270-4d1f-974d-f32cbae2d6b4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1753 microversion: 2.20 time: 0.158468 Aug 08 18:12:08.038131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 230/480] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:07 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:12:08.646401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:08.647014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:08.653915 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:08.654399 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:08.654836 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:08.655521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:08.655978 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:08.656401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:08.783973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:08.791845 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-79f5b565-e029-40d3-b030-80dff8ec6517 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1593 microversion: 2.1 time: 0.149148 Aug 08 18:12:08.792413 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 251/481] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:08 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1593 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:09.061332 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:09.061945 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:09.068342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:09.068858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:09.069293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:09.069983 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:09.070437 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:09.071478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:09.089821 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:09.286843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:09.295700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:09.297171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:09.298325 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-93cd2a64-fb6c-4ec5-8f9a-cfc222bb4f17 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1753 microversion: 2.20 time: 0.241065 Aug 08 18:12:09.298877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 231/482] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:09 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1753 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:10.322224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:10.322842 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:10.329284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:10.329700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:10.330131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:10.330825 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:10.331276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:10.331695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:10.524893 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:10.533508 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:10.535099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:10.536304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-933899c8-281b-4016-a6c2-41b2d094bcdb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.218491 Aug 08 18:12:10.536898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 252/483] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:10 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:11.438864 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-698669b8-6e29-4667-a927-b47892ab4fe9 req-6ba20ff2-1eaa-4952-87c0-0ddbcf8784ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc0adbbe-a03d-4b75-99d2-5a8f9c36567b", "tag": "d266e64e-9c90-4916-b8ce-ab1d6acfc3fe"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:11.450509 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-698669b8-6e29-4667-a927-b47892ab4fe9 req-6ba20ff2-1eaa-4952-87c0-0ddbcf8784ed service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:11.450994 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-698669b8-6e29-4667-a927-b47892ab4fe9 req-6ba20ff2-1eaa-4952-87c0-0ddbcf8784ed service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:11.451424 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-698669b8-6e29-4667-a927-b47892ab4fe9 req-6ba20ff2-1eaa-4952-87c0-0ddbcf8784ed service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:11.473436 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-698669b8-6e29-4667-a927-b47892ab4fe9 req-6ba20ff2-1eaa-4952-87c0-0ddbcf8784ed service nova] Creating event network-changed:d266e64e-9c90-4916-b8ce-ab1d6acfc3fe for instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b on hv-cinder-85236 Aug 08 18:12:11.479918 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-698669b8-6e29-4667-a927-b47892ab4fe9 req-6ba20ff2-1eaa-4952-87c0-0ddbcf8784ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044932 Aug 08 18:12:11.481113 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 232/484] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:11.560117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:11.561086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:11.567814 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:11.568756 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:11.569423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:11.574266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:11.574266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:11.574266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:11.917687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:11.941240 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:11.942651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:11.946755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-10a4b9a1-90a4-41aa-bbf3-3cca83b3a531 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.389764 Aug 08 18:12:11.948173 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 253/485] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:11 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:12:12.973360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:12.974742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:12.985446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:12.991353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:12.993093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:12.994767 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:12.995396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:13.010451 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:13.158647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:13.176415 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:13.178482 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:13.179826 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-89feefce-91b6-4a83-879f-3bb862aa5e2e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.211977 Aug 08 18:12:13.181538 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 233/486] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:12 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:12:14.207305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:14.207935 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:14.214790 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:14.215481 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:14.216099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:14.216987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:14.217585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:14.218182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:14.332917 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2129168382"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:14.337543 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:14.350701 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:14.351184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:14.354235 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:14.355307 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:14.357097 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:14.357549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:14.394116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:14.404269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:14.406138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:14.407644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-52c0f16a-5b40-498d-b441-342ac857f92e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.204257 Aug 08 18:12:14.408376 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 254/487] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:14 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:14.505646 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.network.security_group_api [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Adding security group 3759a092-b0e4-4161-9fd3-7c59f09f7b19 to port d266e64e-9c90-4916-b8ce-ab1d6acfc3fe Aug 08 18:12:15.060551 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-348e3ad1-6d42-4a0e-99ca-35f173830281 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "POST /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/action" status: 202 len: 0 microversion: 2.1 time: 0.731757 Aug 08 18:12:15.061992 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 234/488] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:12:14 2022] POST /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/action => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:12:15.073778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-53049b43-367c-44fd-aa71-27da96c72ea4 req-61e6d63f-8101-4ec8-bfaf-0cd78254db21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc0adbbe-a03d-4b75-99d2-5a8f9c36567b", "tag": "d266e64e-9c90-4916-b8ce-ab1d6acfc3fe"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:15.081239 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:15.081859 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:15.084177 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-53049b43-367c-44fd-aa71-27da96c72ea4 req-61e6d63f-8101-4ec8-bfaf-0cd78254db21 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:15.084885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-53049b43-367c-44fd-aa71-27da96c72ea4 req-61e6d63f-8101-4ec8-bfaf-0cd78254db21 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:15.085552 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-53049b43-367c-44fd-aa71-27da96c72ea4 req-61e6d63f-8101-4ec8-bfaf-0cd78254db21 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:15.088454 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:15.088982 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:15.089629 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:15.090319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:15.090965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:15.091383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:15.100181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-53049b43-367c-44fd-aa71-27da96c72ea4 req-61e6d63f-8101-4ec8-bfaf-0cd78254db21 service nova] Creating event network-changed:d266e64e-9c90-4916-b8ce-ab1d6acfc3fe for instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b on hv-cinder-85236 Aug 08 18:12:15.107836 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-53049b43-367c-44fd-aa71-27da96c72ea4 req-61e6d63f-8101-4ec8-bfaf-0cd78254db21 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037920 Aug 08 18:12:15.109503 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 235/489] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:12:15.269552 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:15.281652 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-95ad9cc0-1b3f-4f29-945a-3f95b826cb0e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1758 microversion: 2.1 time: 0.215534 Aug 08 18:12:15.293727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 255/490] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:15 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:15.441716 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:15.444444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:15.457367 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:15.458142 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:15.458773 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:15.459485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:15.459941 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:15.460397 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:15.611124 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:15.625877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:15.627582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:15.629122 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8dde6d6f-d937-4875-8e94-fde0a858d9f6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.198506 Aug 08 18:12:15.630459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 236/491] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:15 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:16.652180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:16.652993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:16.655122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:16.662425 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:16.662999 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:16.663504 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:16.664622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:16.665151 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:16.665643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:16.813390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:16.821770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:16.823273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:16.824732 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6f66285e-8f6e-4625-a604-d2da4a77c607 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.176441 Aug 08 18:12:16.825299 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 256/492] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:16 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:17.847540 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:17.848153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:17.855197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:17.855686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:17.856131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:17.856937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:17.857398 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:17.857824 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:18.017961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:18.027417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:18.029874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:18.030426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d2cca6ac-814c-45c3-9927-2972d839c6d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.186922 Aug 08 18:12:18.031127 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 237/493] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:17 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:19.053491 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:19.054264 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:19.060714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:19.061195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:19.061620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:19.062301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:19.062759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:19.063166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:19.217096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:19.227753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:19.229596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:19.230874 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b17aec6f-647a-4ec4-a938-e45d8f6147e2 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.181839 Aug 08 18:12:19.231437 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 257/494] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:19 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:20.255163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:20.256803 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:20.265320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:20.265818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:20.266262 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:20.266975 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:20.267438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:20.267863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:20.456749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:20.469850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:20.473028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:20.477454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c99130dc-0ab0-4f56-bd69-4a2d7cd961fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.224528 Aug 08 18:12:20.488059 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 238/495] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:20 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:12:21.499118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:21.499810 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:21.506948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:21.511958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:21.511958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:21.511958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:21.511958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:21.512334 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:21.649594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:21.658903 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:21.660338 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:21.661618 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2fb39e3e-e3fc-4587-b2dc-de931d431291 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.167088 Aug 08 18:12:21.662170 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 258/496] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:21 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:22.685417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:22.686029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:22.692596 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:22.693102 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:22.693536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:22.694294 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:22.694743 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:22.695159 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:22.865177 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:22.878729 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:22.880571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:22.882076 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-74d3c19f-f1a7-482d-bad8-f2ada72a26db tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.201111 Aug 08 18:12:22.882807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 239/497] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:22 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:23.905107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:23.905735 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:23.912236 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:23.912768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:23.913204 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:23.913896 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:23.914357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:23.914772 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.048484 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:24.049789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:24.056477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:24.057151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:24.064856 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.065066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:24.066297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:24.067024 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:24.067654 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.074101 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:24.076089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:24.077686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f1e90841-20ed-4717-946f-29758447d6cb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.177123 Aug 08 18:12:24.092814 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 259/498] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:23 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:24.096784 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9cf203d6-e72f-4005-a34f-3ea2697734b5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425/ips" status: 200 len: 151 microversion: 2.1 time: 0.052170 Aug 08 18:12:24.097370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 240/499] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:12:24 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:24.118413 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eafe21de-a339-4ceb-b117-e2e3acc37040"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:24.121212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:24.128613 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:24.134158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:24.134158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.134158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:24.134158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:24.134511 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.214195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Invalid volume: volume eafe21de-a339-4ceb-b117-e2e3acc37040 is already attached to instances: db7f0620-836d-4a7c-839b-4e8b4a731735 Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: POST /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425/os-volume_attachments HTTP/1.1 Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 74 Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:12:24.216550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {"volumeAttachment": {"volumeId": "eafe21de-a339-4ceb-b117-e2e3acc37040"}} Aug 08 18:12:24.218141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Invalid volume: volume eafe21de-a339-4ceb-b117-e2e3acc37040 is already attached to instances: db7f0620-836d-4a7c-839b-4e8b4a731735 Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'server_id': 'cb281727-027c-4c38-99bb-09d9d1997425', 'body': {'volumeAttachment': {'volumeId': 'eafe21de-a339-4ceb-b117-e2e3acc37040'}}} Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eafe21de-a339-4ceb-b117-e2e3acc37040 is already attached to instances: db7f0620-836d-4a7c-839b-4e8b4a731735 Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:12:24.219092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eafe21de-a339-4ceb-b117-e2e3acc37040 is already attached to instances: db7f0620-836d-4a7c-839b-4e8b4a731735 Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:24.220527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:12:24.221993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:12:24.221993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:12:24.221993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:12:24.221993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eafe21de-a339-4ceb-b117-e2e3acc37040 is already attached to instances: db7f0620-836d-4a7c-839b-4e8b4a731735 Aug 08 18:12:24.221993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:12:24.223169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 400 to user: Invalid volume: volume eafe21de-a339-4ceb-b117-e2e3acc37040 is already attached to instances: db7f0620-836d-4a7c-839b-4e8b4a731735 {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:12:24.224033 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0ae25377-11dd-486f-b16c-a19090b2b51b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110010 Aug 08 18:12:24.224628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 260/500] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:12:24 2022] POST /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 18:12:24.236146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:24.236146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:24.240257 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:24.240782 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:24.241225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.241921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:24.242380 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:24.242808 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.270979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:12:24.629617 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9022a5cf-7b34-4c40-86e8-13a172ae8cce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 204 len: 0 microversion: 2.1 time: 0.399150 Aug 08 18:12:24.630363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 241/501] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:12:24 2022] DELETE /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:12:24.639194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:24.639748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:24.646693 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:24.647203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:24.647615 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.648300 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:24.648794 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:24.649245 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:24.775969 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:24.783975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c5e4c20a-0461-4044-af86-6a2e157fdf91 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1683 microversion: 2.1 time: 0.149376 Aug 08 18:12:24.784561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 261/502] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:24 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:25.102047 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:25.102743 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:25.109422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:25.109924 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:25.110367 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:25.111131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:25.111624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:25.112051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:25.242101 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:25.250571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:25.252081 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:25.253283 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bf717ee0-9571-4aa9-ad43-ea9b6c51b550 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.155731 Aug 08 18:12:25.253833 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 242/503] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:25 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:25.805669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:25.806280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:25.813483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:25.813960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:25.814392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:25.815077 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:25.815528 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:25.815948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:25.941842 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:25.949533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-27530be6-98e4-4886-9b93-bbf4a9764a3f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1683 microversion: 2.1 time: 0.147456 Aug 08 18:12:25.950251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 262/504] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:25 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:26.277262 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:26.277894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:26.284278 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:26.284794 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:26.285235 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:26.285926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:26.286384 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:26.286807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:26.413922 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:26.422237 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:26.423727 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:26.424909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ed76dbc9-d943-48d7-baee-ab37003e3f33 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.152137 Aug 08 18:12:26.425456 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 243/505] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:26 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:26.971148 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:26.971761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:26.978156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:26.978634 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:26.979068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:26.979750 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:26.980880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:26.981306 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:27.111484 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:27.119238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b329934a-db6e-40d2-ad1a-02521312d1d8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1683 microversion: 2.1 time: 0.151917 Aug 08 18:12:27.119812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 263/506] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:26 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:27.447372 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:27.447923 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:27.454584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:27.455068 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:27.455505 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:27.456198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:27.456686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:27.457115 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:27.585320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:27.594119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:27.595626 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:27.596822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cd5207b9-7a15-49b3-8960-0c7c24e92713 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.153448 Aug 08 18:12:27.597385 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 244/507] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:27 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:28.141661 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:28.142213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:28.148537 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:28.149023 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:28.149449 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:28.150137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:28.150587 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:28.151005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:28.283212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:28.290788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-385e8fac-bb67-4db2-909b-a0b97b5212ee tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1683 microversion: 2.1 time: 0.153052 Aug 08 18:12:28.291352 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 264/508] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:28 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:28.618977 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:28.619642 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:28.625946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:28.626428 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:28.626859 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:28.627547 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:28.628001 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:28.628431 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:28.767327 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:28.775594 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:28.777899 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:28.779049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c719db94-5482-4854-83fd-9b1abac87368 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.163949 Aug 08 18:12:28.779605 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 245/509] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:28 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:29.312226 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:29.312857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:29.319174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:29.319650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:29.320071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:29.320768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:29.321214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:29.321631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:29.682435 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:29.689778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d529a07b-d16b-41a3-96d7-ac38a61d538b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1683 microversion: 2.1 time: 0.381417 Aug 08 18:12:29.690331 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 265/510] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:29 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1683 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:29.800805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:29.801423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:29.807822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:29.808827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:29.809274 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:29.809966 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:29.810423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:29.810850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:29.938797 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:29.951203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:29.952964 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:29.954158 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e30fc913-dc0f-484e-b8c7-eb111015543f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.157290 Aug 08 18:12:29.954906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 246/511] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:29 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:30.711636 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:30.712248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:30.718595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:30.719073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:30.719503 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:30.720178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:30.720666 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:30.721089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:30.735649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:30.977652 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:30.978480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:30.986331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:30.986830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:30.987274 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:30.987981 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:30.988437 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:30.988895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:31.032779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:31.041616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3bfdf914-5ecb-4b13-842a-bdf32d18b14d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1683 microversion: 2.1 time: 0.333708 Aug 08 18:12:31.043180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 266/512] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:30 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1683 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:31.299664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:31.308669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:31.310248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:31.311445 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-219cd968-4d40-4e29-8acb-ceafb6cbb1ed tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.338032 Aug 08 18:12:31.312176 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 247/513] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:30 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:12:32.047176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-d560f168-0c97-4f32-bd79-aa6f86a60d02 req-863eaeb9-d883-40a4-b44c-ffe8ea432325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb281727-027c-4c38-99bb-09d9d1997425", "name": "network-vif-deleted", "tag": "0b015091-eabe-4452-b3b7-8651bd39383a"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:32.056635 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d560f168-0c97-4f32-bd79-aa6f86a60d02 req-863eaeb9-d883-40a4-b44c-ffe8ea432325 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:32.057112 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d560f168-0c97-4f32-bd79-aa6f86a60d02 req-863eaeb9-d883-40a4-b44c-ffe8ea432325 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:32.057536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d560f168-0c97-4f32-bd79-aa6f86a60d02 req-863eaeb9-d883-40a4-b44c-ffe8ea432325 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:32.064570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:32.065192 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:32.069142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-d560f168-0c97-4f32-bd79-aa6f86a60d02 req-863eaeb9-d883-40a4-b44c-ffe8ea432325 service nova] Creating event network-vif-deleted:0b015091-eabe-4452-b3b7-8651bd39383a for instance cb281727-027c-4c38-99bb-09d9d1997425 on hv-cinder-85236 Aug 08 18:12:32.072364 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:32.073369 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:32.073842 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:32.074481 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-d560f168-0c97-4f32-bd79-aa6f86a60d02 req-863eaeb9-d883-40a4-b44c-ffe8ea432325 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031483 Aug 08 18:12:32.074969 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:32.075358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 267/514] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:32.075842 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:32.076486 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:32.096536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:32.146446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:32.154389 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-64cedd60-9da7-4690-af71-dc14c8b2a405 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1615 microversion: 2.1 time: 0.094824 Aug 08 18:12:32.159504 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 248/515] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:32 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:32.335749 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:32.336660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:32.344745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:32.346098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:32.346843 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:32.347804 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:32.348582 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:32.348912 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:32.522398 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:32.534527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:32.536723 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:32.539136 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-98014019-d05e-432c-bdd8-ff338764f48c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.207969 Aug 08 18:12:32.553243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 268/516] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:32 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:33.175372 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:33.175987 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:33.185900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:33.186636 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:33.187343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:33.188210 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:33.188848 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:33.189442 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:33.228582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:33.229315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:33.230002 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:33.230605 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lazy-loading 'fault' on Instance uuid cb281727-027c-4c38-99bb-09d9d1997425 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:12:33.275772 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:33.283419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-26b3721a-c81f-4012-8941-e8fb91b1e9f9 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 200 len: 1331 microversion: 2.1 time: 0.111877 Aug 08 18:12:33.286685 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 249/517] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:33 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:33.566342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:33.566939 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:33.573561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:33.574987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:33.575364 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:33.576052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:33.576521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:33.576944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:33.707529 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:33.716039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:33.717579 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:33.718803 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3364d46d-aa25-4425-8860-ce592763fde5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.156352 Aug 08 18:12:33.719392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 269/518] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:33 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:34.304723 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:34.305366 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:34.312856 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:34.313338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:34.313771 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:34.314452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:34.314904 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:34.315326 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:34.329215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 HTTP/1.1 Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:12:34.330816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:12:34.332350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': 'cb281727-027c-4c38-99bb-09d9d1997425'} Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:12:34.333275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:12:34.334520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:34.335732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:12:34.335732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cf69be17-0858-4e9d-b2fe-03d30c5bc02c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 404 len: 111 microversion: 2.1 time: 0.031412 Aug 08 18:12:34.335732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 250/519] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:34 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:12:34.341460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a4eab5a2-72b8-49c7-ad80-1d01006256d5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '.version_select at 0x7f21ac6539d0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:34.423348 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a4eab5a2-72b8-49c7-ad80-1d01006256d5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999811953" status: 202 len: 0 microversion: 2.1 time: 0.085869 Aug 08 18:12:34.423908 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 270/520] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Aug 8 18:12:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999811953 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:12:34.742198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:34.742949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:34.750038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:34.754053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:34.754053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:34.754053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:34.754053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:34.754425 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:34.882543 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:34.891180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:34.892697 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:34.893863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-57b2ae8b-8801-4f76-96cb-90671e4ddcb0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.156174 Aug 08 18:12:34.894406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 251/521] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:34 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:35.223386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:35.223872 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:35.231083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:35.231569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:35.232010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:35.232763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:35.233222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:35.233646 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:35.356726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lazy-loading 'services' on Instance uuid db7f0620-836d-4a7c-839b-4e8b4a731735 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:12:35.553679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a82f977d-f21c-44c2-a34b-bbdedc57a6cc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments/eafe21de-a339-4ceb-b117-e2e3acc37040" status: 202 len: 0 microversion: 2.1 time: 0.334720 Aug 08 18:12:35.554267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 271/522] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:12:35 2022] DELETE /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments/eafe21de-a339-4ceb-b117-e2e3acc37040 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:12:35.562590 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:35.564847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:35.571264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:35.571753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:35.572197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:35.572925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:35.573384 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:35.574304 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:35.603746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b4732bc2-cb82-4468-b64b-266f442872ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Aug 08 18:12:35.604230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 252/523] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:12:35 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:35.917286 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:35.917911 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:35.924071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:35.924588 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:35.925021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:35.925694 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:35.926141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:35.926563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:36.056691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:36.065717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:36.067219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:36.069592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fdc50f3e-7c85-4a41-95cd-0a18b231d5f3 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.155566 Aug 08 18:12:36.069592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 272/524] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:35 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:36.615402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:36.617629 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:36.619951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:36.624586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:36.625097 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:36.625508 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:36.626201 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:36.626683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:36.627108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:36.656111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-77019465-624c-403e-afac-1d33a56765a8 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Aug 08 18:12:36.656700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 253/525] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:12:36 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:37.092489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:37.093137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:37.099604 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:37.100087 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:37.100546 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:37.101237 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:37.101692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:37.102155 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:37.255657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:37.264519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:37.266005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:37.267148 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bed27124-ca16-4611-8e32-4f1a0821d9bf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.179209 Aug 08 18:12:37.267701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 273/526] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:37 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:37.668681 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:37.670924 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:37.677377 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:37.678071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:37.678510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:37.679193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:37.679642 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:37.680060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:37.709594 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f3d808c3-998c-47e9-b7ce-7c46f18c5e6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045756 Aug 08 18:12:37.710146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 254/527] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:12:37 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:38.289726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:38.290328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:38.297310 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:38.297786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:38.298217 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:38.298897 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:38.299346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:38.299766 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:38.426368 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:38.434758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:38.436250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:38.437430 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-faa23dfe-cf55-4eea-946c-1959f7fb8f77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.151567 Aug 08 18:12:38.438017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 274/528] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:38 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:38.723368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:38.725548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:38.732176 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:38.732708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:38.733149 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:38.733845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:38.734299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:38.734722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:38.763052 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-95a43565-8b21-408e-b588-dbc595cd5e90 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043701 Aug 08 18:12:38.763604 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 255/529] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:12:38 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:12:38.825898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:38.826413 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:38.832174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:38.832679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:38.833108 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:38.833777 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:38.834221 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:38.834643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:38.861140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Going to try to terminate instance {{(pid=118382) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:12:39.263317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1ebee054-e569-493c-98ad-ede776e7dfc6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 204 len: 0 microversion: 2.1 time: 0.441824 Aug 08 18:12:39.263902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 275/530] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:12:38 2022] DELETE /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 18:12:39.272007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:39.272647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:39.278517 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:39.279005 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:39.279442 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:39.280128 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:39.280605 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:39.281033 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:39.414206 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:39.422577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ff41f481-73e1-40a0-8a79-b8d9bfbe1f41 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1682 microversion: 2.1 time: 0.154422 Aug 08 18:12:39.437770 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 256/531] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:39 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:39.469554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:39.469554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:39.481203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:39.481713 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:39.482132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:39.482835 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:39.483291 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:39.483715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:39.612364 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:39.621410 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:39.622927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:39.624098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e3eed957-6362-4ce5-b6a7-26e1c9fe513f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.166158 Aug 08 18:12:39.624688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 276/532] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:39 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:40.443929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:40.444567 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:40.451906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:40.452382 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:40.452846 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:40.453528 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:40.453982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:40.454401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:40.582722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:40.590231 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d307c284-475b-4384-9560-1aa7232f16a7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1682 microversion: 2.1 time: 0.150136 Aug 08 18:12:40.590781 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 257/533] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:40 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:40.647777 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:40.648352 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:40.654744 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:40.655220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:40.655658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:40.656342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:40.656846 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:40.657269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:40.783120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:40.791506 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:40.793526 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:40.794679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4b339ea5-596c-42d2-b01f-e8ecf2cdcdc4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.150876 Aug 08 18:12:40.795228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 277/534] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:40 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:41.490501 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-ff458aea-47c8-4ea3-ac63-46778f1d05fe req-b85d2422-652d-4da9-bdb0-c376d80e25eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c18185-5443-4967-832b-8cec6d6aa044", "name": "network-vif-plugged", "status": "completed", "tag": "364cbc31-b2c9-4de9-a7cd-715d07c15ee5"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:41.500343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ff458aea-47c8-4ea3-ac63-46778f1d05fe req-b85d2422-652d-4da9-bdb0-c376d80e25eb service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:41.500858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ff458aea-47c8-4ea3-ac63-46778f1d05fe req-b85d2422-652d-4da9-bdb0-c376d80e25eb service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:41.501286 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ff458aea-47c8-4ea3-ac63-46778f1d05fe req-b85d2422-652d-4da9-bdb0-c376d80e25eb service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:41.512337 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-ff458aea-47c8-4ea3-ac63-46778f1d05fe req-b85d2422-652d-4da9-bdb0-c376d80e25eb service nova] Creating event network-vif-plugged:364cbc31-b2c9-4de9-a7cd-715d07c15ee5 for instance 87c18185-5443-4967-832b-8cec6d6aa044 on hv-cinder-85236 Aug 08 18:12:41.517239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-ff458aea-47c8-4ea3-ac63-46778f1d05fe req-b85d2422-652d-4da9-bdb0-c376d80e25eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030499 Aug 08 18:12:41.517863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 258/535] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:41.611248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:41.611858 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:41.617895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:41.618403 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:41.618834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:41.619514 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:41.619960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:41.620375 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:41.755271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:41.755852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:41.762543 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:41.763044 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:41.763484 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:41.764251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:41.764739 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:41.765168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:41.792027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:41.799438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-72c6eb75-dca3-4512-8d5a-90c36acd39a4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1682 microversion: 2.1 time: 0.192118 Aug 08 18:12:41.800066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 278/536] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:41 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:41.817767 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:41.818453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:41.825581 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:41.826117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:41.826550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:41.827233 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:41.827680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:41.828096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:41.891069 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lazy-loading 'services' on Instance uuid 2d934484-9583-4162-bd95-ff93c9ff9372 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:12:41.959659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:41.968578 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:41.970131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:41.971299 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7899a1f2-8e40-4cc1-ad24-e274d66f3463 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.157334 Aug 08 18:12:41.971865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 279/537] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:41 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:12:42.137221 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c160c52e-889a-4948-afea-3173079b33af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/os-volume_attachments/7d09af3f-4ecf-45f2-a9ae-bf1217296233" status: 202 len: 0 microversion: 2.1 time: 0.386045 Aug 08 18:12:42.138648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 259/538] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:12:41 2022] DELETE /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/os-volume_attachments/7d09af3f-4ecf-45f2-a9ae-bf1217296233 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:12:42.821226 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:42.821843 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:42.829010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:42.829486 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:42.829914 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:42.830617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:42.831062 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:42.831477 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:42.912535 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:42.920938 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-31e1c702-b318-4760-a23c-70addf274837 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1615 microversion: 2.1 time: 0.103314 Aug 08 18:12:42.921545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 280/539] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:42 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1615 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:43.001317 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-01eae963-8fec-49fa-b26a-0d785a171cfe req-f7b67f1b-8435-4618-b95f-8d27d8fca4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7f0620-836d-4a7c-839b-4e8b4a731735", "name": "network-vif-deleted", "tag": "a21e40e5-f7d3-406d-9c1e-3e308ac51699"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:43.003112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:43.007732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:43.019391 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-01eae963-8fec-49fa-b26a-0d785a171cfe req-f7b67f1b-8435-4618-b95f-8d27d8fca4b7 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:43.019870 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-01eae963-8fec-49fa-b26a-0d785a171cfe req-f7b67f1b-8435-4618-b95f-8d27d8fca4b7 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:43.022578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:43.029946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-01eae963-8fec-49fa-b26a-0d785a171cfe req-f7b67f1b-8435-4618-b95f-8d27d8fca4b7 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:43.030214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:43.030214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:43.030214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:43.030214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:43.030556 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:43.046347 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-01eae963-8fec-49fa-b26a-0d785a171cfe req-f7b67f1b-8435-4618-b95f-8d27d8fca4b7 service nova] Creating event network-vif-deleted:a21e40e5-f7d3-406d-9c1e-3e308ac51699 for instance db7f0620-836d-4a7c-839b-4e8b4a731735 on hv-cinder-85236 Aug 08 18:12:43.057392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-01eae963-8fec-49fa-b26a-0d785a171cfe req-f7b67f1b-8435-4618-b95f-8d27d8fca4b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062002 Aug 08 18:12:43.064420 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 281/540] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:12:43.189105 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:43.201394 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:43.203891 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:43.206189 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e51b736-2068-415c-ab33-7d5b1dde4194 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.213438 Aug 08 18:12:43.207216 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 260/541] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:42 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:43.943157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:43.943983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:43.951081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:43.951637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:43.952075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:43.952803 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:43.953259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:43.953756 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:43.984595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:43.985079 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:43.985512 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:43.985963 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lazy-loading 'fault' on Instance uuid db7f0620-836d-4a7c-839b-4e8b4a731735 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:12:44.031527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:44.038125 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:44.045243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4eab0bc8-9d99-44cb-8487-4cec88c01871 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1332 microversion: 2.1 time: 0.106862 Aug 08 18:12:44.046477 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 282/542] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:43 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:44.231284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:44.232103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:44.238435 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:44.239449 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:44.239449 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:44.240050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:44.240522 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:44.240967 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:44.326186 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d96f335d-7872-4da4-b5f3-4ac5f29911c6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:44.332806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d96f335d-7872-4da4-b5f3-4ac5f29911c6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:44.333289 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d96f335d-7872-4da4-b5f3-4ac5f29911c6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:44.333719 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d96f335d-7872-4da4-b5f3-4ac5f29911c6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:44.358056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d96f335d-7872-4da4-b5f3-4ac5f29911c6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Going to try to stop instance {{(pid=118382) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 18:12:44.374991 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:44.383676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:44.385232 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:44.386404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2eb71298-a3d8-4dc1-b418-fbfdc9d18dcf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.159161 Aug 08 18:12:44.386964 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 261/543] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:44 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:44.489335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d96f335d-7872-4da4-b5f3-4ac5f29911c6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/action" status: 202 len: 0 microversion: 2.1 time: 0.167623 Aug 08 18:12:44.489865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 283/544] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:12:44 2022] POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:12:44.498717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:44.499326 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:44.505364 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:44.505848 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:44.506331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:44.507028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:44.507487 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:44.507912 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:44.637610 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:44.646019 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-52bb0a3f-89ee-4af1-a671-195dc8417c2c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.151137 Aug 08 18:12:44.658717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 262/545] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:44 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:45.072066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:45.072802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:45.079874 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:45.080360 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:45.080825 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:45.081517 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:45.081975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:45.082395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:45.113294 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:45.113778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:45.114216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:45.114657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lazy-loading 'fault' on Instance uuid db7f0620-836d-4a7c-839b-4e8b4a731735 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:12:45.162179 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:45.169852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e4a95180-09dc-447a-b662-8a90d464ec07 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 200 len: 1332 microversion: 2.1 time: 0.102476 Aug 08 18:12:45.170422 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 284/546] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:45 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:45.409596 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:45.410195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:45.416609 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:45.417091 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:45.417515 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:45.418192 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:45.418640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:45.419056 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:45.549833 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:45.558344 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:45.560370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:45.561561 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f2a781ec-2f77-4797-9b11-3c283adca326 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1809 microversion: 2.20 time: 0.155886 Aug 08 18:12:45.562125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 263/547] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:45 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:12:45.666372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:45.666987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:45.672927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:45.673401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:45.673826 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:45.674529 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:45.674985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:45.675396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:45.806760 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:45.814865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fd9ca9e2-4fa0-4e1d-8b06-c237ece0e5bd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.152666 Aug 08 18:12:45.815436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 285/548] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:45 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:46.191663 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:46.192181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:46.198237 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:46.198739 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:46.199176 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:46.199882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:46.200621 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:46.201044 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:46.214377 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 HTTP/1.1 Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:12:46.216141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:12:46.217711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': 'db7f0620-836d-4a7c-839b-4e8b4a731735'} Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:12:46.218564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:12:46.219845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:12:46.221438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:12:46.221438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-62093c9f-72d2-4e6c-80fe-ba5e4b51ad28 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 404 len: 111 microversion: 2.1 time: 0.029938 Aug 08 18:12:46.221438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 264/549] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:46 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 18:12:46.226266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ae7e5306-3bab-4fed-9d45-286d974bf12a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '.version_select at 0x7f21ac96a550>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:46.333379 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ae7e5306-3bab-4fed-9d45-286d974bf12a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788924181" status: 202 len: 0 microversion: 2.1 time: 0.110717 Aug 08 18:12:46.333970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 286/550] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 18:12:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788924181 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:12:46.585418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:46.586025 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:46.592863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:46.593342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:46.593771 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:46.594457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:46.594917 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:46.595333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:46.837462 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:46.838079 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:46.844845 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:46.845338 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:46.845770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:46.846468 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:46.846918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:46.847338 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:47.113631 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:47.122823 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:47.124586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:47.125775 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a5598ddf-0f6d-4396-895b-8ebb74329a99 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1796 microversion: 2.20 time: 0.544322 Aug 08 18:12:47.126323 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 265/551] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:12:46 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1796 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:12:47.151575 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:47.159275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b1cc3e09-797c-46ff-ab5e-a057c4432c94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.326126 Aug 08 18:12:47.160783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 287/552] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:46 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:47.478138 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3b90694c-81e8-403a-8631-618142494ade tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: .version_select at 0x7f21ad860b80>, body: {"keypair": {"name": "tempest-keypair-1818077734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP6f0AYVgacgqliJ97VqaK/GDJqd8y3s4Hu1VE0qNK2/jez6m71IiRPqYtpArXAcLamXCXSGLqxSaxoYo5loaG+PdqjmpwFnL7osxL2W3Y55Jfzrh3YrUPhEz2/j6vsUQ=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:47.496032 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-3b90694c-81e8-403a-8631-618142494ade tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:12:47.500560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-3b90694c-81e8-403a-8631-618142494ade tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for user 2d5e7d5c77084705b1f39406293ab585 and project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:12:47.578965 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3b90694c-81e8-403a-8631-618142494ade tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105436 Aug 08 18:12:47.579558 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 266/553] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:12:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:48.179948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:48.180589 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:48.187197 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:48.187717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:48.188164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:48.188877 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:48.189328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:48.189748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:48.358904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:48.366339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-931ab5ed-5b62-493e-929b-deac2bfda510 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.190270 Aug 08 18:12:48.366912 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 288/554] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:48 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:49.388490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:49.389178 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:49.395041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:49.395521 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:49.395952 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:49.396666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:49.397166 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:49.401205 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:49.402664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:49.600423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:49.608635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a3a6f1fb-22a6-4eee-93cc-8c1951af6efd tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.225187 Aug 08 18:12:49.609204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 267/555] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:49 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:49.739806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-284694213", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47bba831-90ff-4040-8010-199ec976c9aa"}], "security_groups": [{"name": "tempest-securitygroup--456423210"}], "key_name": "tempest-keypair-1818077734", "user_data": "}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:49.748811 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:49.844069 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] validate_networks() for [('47bba831-90ff-4040-8010-199ec976c9aa', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:12:50.216701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:12:50.217127 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:12:50.217596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:12:50.218011 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:12:50.218420 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:12:50.227213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:50.227689 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:50.228125 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:50.228884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:50.229337 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:50.229758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:50.247041 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:12:50.251089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for user 2d5e7d5c77084705b1f39406293ab585 and project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:12:50.262074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:12:50.264318 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:12:50.400738 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:50.402889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:50.409852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:50.410337 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:50.410773 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:50.411462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:50.411917 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:50.412365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:50.442554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-06cef7ba-fa11-4654-8baf-0fd0f105c528 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.706919 Aug 08 18:12:50.443740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 289/556] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:12:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:12:50.455173 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f2226ae3-f47c-4e7c-bb71-45e73961b614 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:50.456070 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f2226ae3-f47c-4e7c-bb71-45e73961b614 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:50.519405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f2226ae3-f47c-4e7c-bb71-45e73961b614 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:50.526244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f2226ae3-f47c-4e7c-bb71-45e73961b614 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1241 microversion: 2.1 time: 0.075797 Aug 08 18:12:50.527036 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 290/557] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:50 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:50.630281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:50.631001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:50.631352 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6075260f-0273-4f5e-9d9d-5b3471d12bcb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "POST /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/action" status: 202 len: 0 microversion: 2.1 time: 0.234432 Aug 08 18:12:50.632317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 268/558] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:12:50 2022] POST /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:12:50.641998 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:50.643041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:50.646947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:50.647472 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:50.647923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:50.648739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:50.649200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:50.649632 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:50.649763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:50.650095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:50.650528 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:50.651276 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:50.651670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:50.652087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:50.888430 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:50.897653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5ada3e07-85cb-4e77-85a4-c47c1d444d94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.272046 Aug 08 18:12:50.898282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 291/559] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:50 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:50.913648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:50.924528 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3fe23102-021f-4ad4-bb5b-b1b962ea4f3d tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1750 microversion: 2.1 time: 0.287280 Aug 08 18:12:50.925113 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 269/560] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:50 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1750 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:51.548048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:51.548591 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:51.554668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:51.555147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:51.555581 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:51.556347 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:51.556832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:51.557283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:51.625624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:51.633081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b78a1039-ae34-4650-8046-bb31109447c2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1245 microversion: 2.1 time: 0.089818 Aug 08 18:12:51.633860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 292/561] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:51 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:51.919075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:51.919718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:51.926299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:51.926821 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:51.927263 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:51.927959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:51.928421 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:51.928917 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:51.947323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:51.948610 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:51.957677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:51.958191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:51.958624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:51.959313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:51.959768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:51.960312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:52.116343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:52.124138 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d0e5a04b-3330-469c-a140-e78581216f0a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.208853 Aug 08 18:12:52.134416 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 270/562] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:51 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:52.152624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:52.161168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e77277dd-0482-4cfb-ab42-c01d454c8e54 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.218320 Aug 08 18:12:52.161729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 293/563] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:51 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:52.654208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:52.654860 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:52.661269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:52.661802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:52.662247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:52.662944 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:52.663400 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:52.663827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:52.758473 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:52.766764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b891918e-0316-4cda-9688-7431bcbe09ab tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1301 microversion: 2.1 time: 0.117171 Aug 08 18:12:52.767538 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 271/564] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:52 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1301 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:53.146126 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:53.146941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:53.153571 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:53.154046 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:53.154472 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:53.155154 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:53.155595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:53.156012 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:53.189080 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:53.189740 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:53.197094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:53.197579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:53.198130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:53.198895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:53.199422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:53.199912 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:53.412759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:53.420761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ca82bd04-9348-4eea-b4aa-d28f7c8a6fd8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.278516 Aug 08 18:12:53.421325 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 294/565] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:53 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:53.482351 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:53.490387 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-59da86f3-b246-49d7-bae1-0b1c95e8d8cb tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.307138 Aug 08 18:12:53.490954 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 272/566] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:53 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:53.788999 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:53.790133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:53.804585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:53.804585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:53.804585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:53.804585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:53.805528 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:53.805528 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:54.033438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:54.040754 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7ad031ae-ff0c-4d7a-b3fd-bf6030fc8ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.256488 Aug 08 18:12:54.041327 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 295/567] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:53 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:54.442011 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:54.442618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:54.449278 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:54.449778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:54.450189 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:54.451753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:54.452204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:54.452650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:54.511286 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:54.512035 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:54.519136 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:54.519624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:54.520061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:54.520817 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:54.521274 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:54.521698 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:54.667948 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:54.675536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4216f855-6cd9-4d7f-ae14-4abd6b9a13d8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.237323 Aug 08 18:12:54.676107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 273/568] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:54 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:54.680542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-0fe156b6-5577-452e-a54d-3c19fb0c484b req-6bfc926c-59cd-4218-956e-e18995c8ede9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f14da550-cc04-4944-ab43-06c1599eb76d", "tag": "ef012167-4a38-44b0-b9ca-33901ecd9187"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:54.691153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-0fe156b6-5577-452e-a54d-3c19fb0c484b req-6bfc926c-59cd-4218-956e-e18995c8ede9 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:54.691617 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-0fe156b6-5577-452e-a54d-3c19fb0c484b req-6bfc926c-59cd-4218-956e-e18995c8ede9 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:54.692609 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-0fe156b6-5577-452e-a54d-3c19fb0c484b req-6bfc926c-59cd-4218-956e-e18995c8ede9 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:54.708411 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-0fe156b6-5577-452e-a54d-3c19fb0c484b req-6bfc926c-59cd-4218-956e-e18995c8ede9 service nova] Creating event network-changed:ef012167-4a38-44b0-b9ca-33901ecd9187 for instance f14da550-cc04-4944-ab43-06c1599eb76d on hv-cinder-85236 Aug 08 18:12:54.710382 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-0fe156b6-5577-452e-a54d-3c19fb0c484b req-6bfc926c-59cd-4218-956e-e18995c8ede9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033162 Aug 08 18:12:54.710979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 274/569] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:12:54.745133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:54.753858 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-390771d1-93b7-44bb-b16d-b908a33db9b0 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.246501 Aug 08 18:12:54.754459 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 296/570] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:54 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:55.063771 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:55.064472 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:55.070648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:55.071134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:55.071651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:55.072447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:55.073720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:55.073720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:55.225510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:55.233649 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d454a06f-a1f0-4f3e-8dae-609ac4fcff38 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.174794 Aug 08 18:12:55.234213 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 275/571] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:55 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:55.697702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:55.698315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:55.705288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:55.705770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:55.706204 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:55.706917 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:55.707368 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:55.707787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:55.775162 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:55.775768 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:55.783004 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:55.783482 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:55.783913 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:55.784677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:55.786481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:55.786481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:55.870286 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:55.878095 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-86b4d149-f3b3-4097-9def-46cecbb548c8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1679 microversion: 2.1 time: 0.184311 Aug 08 18:12:55.878706 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 297/572] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:55 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:55.943544 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:55.952070 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9325ba6e-e55c-402e-a1fd-1f7bc491e889 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.180758 Aug 08 18:12:55.952653 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 276/573] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:55 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:56.254124 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:56.254739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:56.260799 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:56.261301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:56.261729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:56.262433 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:56.263566 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:56.263994 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:56.424888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:56.432232 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2c7057d0-a8ba-49fe-9dbc-114093cbab89 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.182081 Aug 08 18:12:56.433051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 298/574] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:56 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:56.899230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:56.899957 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:56.906877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:56.907438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:56.907880 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:56.908605 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:56.909070 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:56.909496 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:56.973051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:56.973680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:56.980131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:56.980649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:56.981144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:56.982421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:56.982867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:56.983281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:57.089536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:57.097599 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0b8e79f6-f1d0-42e4-b853-bed41e391c2f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1656 microversion: 2.1 time: 0.202255 Aug 08 18:12:57.102829 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 277/575] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:56 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1656 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:57.118446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-316564ea-4b50-4bc3-8617-15f7a417020c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:57.124958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-316564ea-4b50-4bc3-8617-15f7a417020c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:57.127095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-316564ea-4b50-4bc3-8617-15f7a417020c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:57.127095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-316564ea-4b50-4bc3-8617-15f7a417020c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:57.149941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:57.159025 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-15d163ee-2dc7-4398-8349-e5a6a89c8a8b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.189761 Aug 08 18:12:57.159602 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 299/576] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:56 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:57.187378 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-316564ea-4b50-4bc3-8617-15f7a417020c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Going to try to start instance {{(pid=118381) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 18:12:57.311887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-316564ea-4b50-4bc3-8617-15f7a417020c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/action" status: 202 len: 0 microversion: 2.1 time: 0.197090 Aug 08 18:12:57.312522 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 278/577] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:12:57 2022] POST /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:12:57.327207 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:57.327835 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:57.333680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:57.334098 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:57.334528 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:57.335341 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:57.335785 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:57.336200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:57.454160 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:57.455298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:57.462481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:57.462966 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:57.463906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:57.465151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:57.466627 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:57.467217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:57.468938 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:57.471225 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:57.477649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-16bc7f97-a258-4021-b6d3-698308c0c371 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1665 microversion: 2.1 time: 0.154821 Aug 08 18:12:57.478306 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 300/578] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:57 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:57.507303 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=4 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:57.693490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:57.701726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8b3fe433-1041-49fb-bcc6-4bbdcc7d9dea tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.252521 Aug 08 18:12:57.702289 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 279/579] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:57 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:58.180120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:58.180759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:58.188693 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:58.189185 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:58.189620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:58.190323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:58.190779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:58.191557 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:58.404381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:58.412466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-77eea0b8-bda5-47a9-ba6e-de67c9caebd9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.236284 Aug 08 18:12:58.413087 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 301/580] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:58 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:58.498147 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:58.498686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:58.505133 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:58.505665 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:58.506111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:58.506841 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:58.507306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:58.507726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:58.634553 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:58.642419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-39caea03-6b4d-4a6a-b7d9-00842156ac94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1665 microversion: 2.1 time: 0.148242 Aug 08 18:12:58.642979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 280/581] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:58 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:58.722649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:58.723259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:58.729207 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:58.729686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:58.730148 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:58.730831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:58.731281 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:58.731707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:58.865378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:58.872703 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b9f26830-3ab2-4cf1-9bc2-1dd77e37d9dd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.153839 Aug 08 18:12:58.873275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 302/582] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:58 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:12:59.434197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:59.435548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:59.441494 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:59.441988 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:59.442428 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:59.443134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:59.443590 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:59.444063 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:59.520286 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38d05c4a-8b63-4dd7-8541-aea77d415513"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:12:59.522903 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:59.530388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:59.530388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:59.530758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:59.531537 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:59.532052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:59.532570 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:59.630405 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:59.638546 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cf44fa88-30a3-465e-a39c-63ec763563e9 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.208209 Aug 08 18:12:59.639111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 281/583] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:59 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:59.664537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:59.665071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:59.671695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:59.672198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:59.676761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:59.677646 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:59.678161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:59.678589 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:59.698578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:12:59.815572 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:12:59.822955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-92c2742d-701b-495b-afa9-aa4fa22fc409 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1669 microversion: 2.1 time: 0.163632 Aug 08 18:12:59.823542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 282/584] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:59 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:12:59.892988 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:12:59.893718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:12:59.900703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:59.901930 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:59.901930 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:12:59.902302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:12:59.902758 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:12:59.903181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:00.038259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:00.046113 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-41f913ad-9c3b-438c-9a4e-1365389b1460 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.157082 Aug 08 18:13:00.048247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 283/585] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:12:59 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:13:00.210443 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-75275a1f-d614-4bb5-a278-c8a06c31f236 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694184 Aug 08 18:13:00.211056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 303/586] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:12:59 2022] POST /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:13:00.659762 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:00.660379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:00.666980 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:00.667467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:00.667907 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:00.668627 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:00.669090 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:00.669518 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:00.809078 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:00.817650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b8a28784-c63a-48ce-963c-451f0af05079 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.162226 Aug 08 18:13:00.818240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 284/587] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:00 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:01.064198 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:01.065446 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=8 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:01.069621 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:01.070310 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:01.077779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:01.078274 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:01.078700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:01.079382 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:01.079954 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:01.080414 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:01.213903 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:01.222126 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-581454eb-5945-4929-b22f-9ad48ea59ea0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.159031 Aug 08 18:13:01.226468 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 304/588] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:01 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:01.651478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-e3ff6699-50ab-4e37-843f-f97c408e70da req-112ae424-738c-4050-a7d8-1ed7603129d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f14da550-cc04-4944-ab43-06c1599eb76d", "name": "network-vif-plugged", "status": "completed", "tag": "ef012167-4a38-44b0-b9ca-33901ecd9187"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:01.662080 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e3ff6699-50ab-4e37-843f-f97c408e70da req-112ae424-738c-4050-a7d8-1ed7603129d1 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:01.662674 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e3ff6699-50ab-4e37-843f-f97c408e70da req-112ae424-738c-4050-a7d8-1ed7603129d1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:01.663025 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e3ff6699-50ab-4e37-843f-f97c408e70da req-112ae424-738c-4050-a7d8-1ed7603129d1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:01.674007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-e3ff6699-50ab-4e37-843f-f97c408e70da req-112ae424-738c-4050-a7d8-1ed7603129d1 service nova] Creating event network-vif-plugged:ef012167-4a38-44b0-b9ca-33901ecd9187 for instance f14da550-cc04-4944-ab43-06c1599eb76d on hv-cinder-85236 Aug 08 18:13:01.679007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-e3ff6699-50ab-4e37-843f-f97c408e70da req-112ae424-738c-4050-a7d8-1ed7603129d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031169 Aug 08 18:13:01.683881 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 285/589] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:01.839166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:01.839783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:01.847074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:01.847555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:01.847984 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:01.848695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:01.849197 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:01.849666 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:02.028669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:02.036602 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f441d1c3-d545-4f57-80b4-3dee98c0619f tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.201298 Aug 08 18:13:02.037182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 305/590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:01 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:02.243928 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:02.244658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:02.251439 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:02.251925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:02.252360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:02.253082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:02.253537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:02.253960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:02.384839 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:02.392213 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5917617e-f1f6-4440-b402-312cfd578da4 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.152451 Aug 08 18:13:02.392801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 286/591] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:02 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:03.057066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:03.057597 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:03.064056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:03.068428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:03.068428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:03.068428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:03.068428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:03.068836 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:03.210500 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:03.219928 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-49fad575-611e-4c03-a800-b1f1f58fd116 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.166796 Aug 08 18:13:03.220539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 306/592] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:03 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:03.412403 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:03.412922 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:03.419299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:03.419787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:03.420224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:03.420944 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:03.421405 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:03.421831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:03.551843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:03.560290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-66423798-765a-4a49-8832-b5195e5c9a92 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1366 microversion: 2.1 time: 0.151200 Aug 08 18:13:03.560917 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 287/593] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:03 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:04.241088 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:04.241753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:04.248136 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:04.248651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:04.249157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:04.249942 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:04.250276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:04.250698 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:04.474980 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:04.500688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-47b63e67-6cbf-4be4-9831-e9a76e4499a8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.263449 Aug 08 18:13:04.501481 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 307/594] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:04 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:04.581435 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:04.582182 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:04.588752 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:04.589255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:04.589711 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:04.590406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:04.591355 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:04.591779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:04.797167 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:04.805066 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-314fcb83-cf21-4060-98ce-1f54e819e400 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1556 microversion: 2.1 time: 0.227452 Aug 08 18:13:04.805646 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 288/595] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:04 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1556 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:04.824999 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:04.826228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:04.832117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:04.832622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:04.833056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:04.833734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:04.834182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:04.834668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:04.913178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a7e0ecda-eb5e-4437-a2e9-c4af2fba4e3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092193 Aug 08 18:13:04.913775 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 308/596] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 18:13:04 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:05.521978 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:05.522679 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:05.529479 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:05.530078 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:05.530590 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:05.531369 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:05.531927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:05.532412 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:05.788725 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:05.797754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-93776528-c31e-443f-883b-8b262ef24499 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.279782 Aug 08 18:13:05.798336 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 289/597] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:05 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:06.041373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-1f54c4c5-6b74-4c32-8501-1d2a4f3dc3ee req-d96511e7-1ebe-4033-9b77-8ba42f33face service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f14da550-cc04-4944-ab43-06c1599eb76d", "tag": "ef012167-4a38-44b0-b9ca-33901ecd9187"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:06.051685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1f54c4c5-6b74-4c32-8501-1d2a4f3dc3ee req-d96511e7-1ebe-4033-9b77-8ba42f33face service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:06.052462 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1f54c4c5-6b74-4c32-8501-1d2a4f3dc3ee req-d96511e7-1ebe-4033-9b77-8ba42f33face service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:06.052934 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1f54c4c5-6b74-4c32-8501-1d2a4f3dc3ee req-d96511e7-1ebe-4033-9b77-8ba42f33face service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:06.065163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-1f54c4c5-6b74-4c32-8501-1d2a4f3dc3ee req-d96511e7-1ebe-4033-9b77-8ba42f33face service nova] Creating event network-changed:ef012167-4a38-44b0-b9ca-33901ecd9187 for instance f14da550-cc04-4944-ab43-06c1599eb76d on hv-cinder-85236 Aug 08 18:13:06.070597 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-1f54c4c5-6b74-4c32-8501-1d2a4f3dc3ee req-d96511e7-1ebe-4033-9b77-8ba42f33face service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033439 Aug 08 18:13:06.071227 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 309/598] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:06.818761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:06.819373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:06.826751 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:06.827233 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:06.827668 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:06.828354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:06.828835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:06.829253 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:07.278942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:07.287067 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3e9f5a2a-e1db-4a80-905d-d152dea99d44 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1755 microversion: 2.1 time: 0.472164 Aug 08 18:13:07.287646 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 290/599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:06 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1755 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:08.311958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:08.312696 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:08.318767 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:08.320795 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:08.320795 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:08.320795 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:08.320795 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:08.321288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:08.468147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:08.476142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-baf41927-c5e3-45e3-a35c-b050744658f8 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1758 microversion: 2.1 time: 0.169518 Aug 08 18:13:08.476735 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 310/600] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:08 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:08.788172 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:08.790524 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:08.793075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:08.798532 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:08.804143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:08.804143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:08.804143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:08.804143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:08.805174 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:08.823937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lazy-loading 'flavor' on Instance uuid ca3a285c-f9d9-4be0-b67e-94e7a7eee516 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:13:09.097897 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ce59ef19-9a3d-4d29-9ac4-1118b3ee22a0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/action" status: 200 len: 32 microversion: 2.1 time: 0.313562 Aug 08 18:13:09.098662 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 291/601] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:13:08 2022] POST /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:13:09.108821 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:09.109558 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:09.116162 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:09.116680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:09.117118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:09.117816 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:09.118273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:09.118690 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:09.287599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:09.295561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f4d543c2-04d5-4f2a-919b-7b7c7e41b3a9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.190973 Aug 08 18:13:09.296140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 311/602] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:09 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:10.320083 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:10.320807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:10.327207 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:10.327689 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:10.328121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:10.328843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:10.329298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:10.329718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:10.460947 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:10.469277 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a1506831-3297-4aed-8c94-b274e1676f4d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.153916 Aug 08 18:13:10.469849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 292/603] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:10 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:11.490575 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:11.491188 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:11.497984 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:11.498469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:11.499490 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:11.500179 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:11.500676 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:11.501105 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:11.627374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:11.635154 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6c63adaa-76ba-4390-b351-6c30614ecaa7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.148572 Aug 08 18:13:11.635717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 312/604] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:11 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:12.656183 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:12.656821 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:12.663151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:12.663628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:12.664060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:12.664763 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:12.665224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:12.665665 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:12.795434 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:12.804033 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-19bb7c6c-f469-46d9-a14a-d97efda1bf35 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.151465 Aug 08 18:13:12.804450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 293/605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:12 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:13.825702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:13.826642 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:13.833017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:13.833485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:13.833911 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:13.834581 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:13.835024 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:13.835435 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:13.961392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:13.969767 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1913d6f3-a2f4-44dd-a038-3279c1fb5d14 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.147933 Aug 08 18:13:13.970327 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 313/606] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:13 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:14.991077 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:14.991684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:14.998142 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:14.998662 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:14.999102 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:14.999792 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:15.000244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:15.000697 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:15.127243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:15.135122 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6787c214-6429-4ced-bf3e-9bed6c2b58c4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.148037 Aug 08 18:13:15.135684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 294/607] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:14 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:16.157725 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:16.158269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:16.164764 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:16.165236 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:16.165667 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:16.166342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:16.166786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:16.167200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:16.298219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:16.306197 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-88dd9d15-5268-4a7f-acbf-ef28f3a3a464 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.153051 Aug 08 18:13:16.306808 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 314/608] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:16 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:17.328890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:17.329556 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:17.336188 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:17.336715 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:17.337152 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:17.337844 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:17.338298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:17.338720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:17.466186 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:17.474746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5b506929-3d64-401b-bab3-8065208c340c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.150654 Aug 08 18:13:17.475313 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 295/609] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:17 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:18.495645 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:18.496256 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:18.502799 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:18.503277 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:18.503707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:18.504384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:18.504863 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:18.505284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:18.639461 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:18.647419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-94abb031-b946-4bbf-8ca3-965a0319a6c7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.155570 Aug 08 18:13:18.648251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 315/610] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:18 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:19.667968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:19.668604 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:19.675523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:19.676008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:19.676450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:19.677162 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:19.677619 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:19.678043 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:19.806823 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:19.815208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-13cfe421-7d84-4f36-9f97-a54289bc2d9e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.151094 Aug 08 18:13:19.815825 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 296/611] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:19 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:20.837522 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:20.838167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:20.840651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:20.847167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:20.847653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:20.848091 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:20.848819 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:20.849305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:20.852771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:20.980435 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:20.990447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-38574490-248c-42f2-b835-c52fea54817b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.156412 Aug 08 18:13:20.991135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 316/612] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:20 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:22.015148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:22.015758 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:22.022182 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:22.022667 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:22.023101 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:22.023795 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:22.024250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:22.024712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:22.150781 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:22.154296 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:22.159047 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-489ece4c-ab97-46c1-913d-5526be2fbd02 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.147825 Aug 08 18:13:22.159614 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 297/613] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:22 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:23.180331 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:23.180920 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:23.187585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:23.188065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:23.188497 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:23.189206 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:23.189658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:23.190084 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:23.193949 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:23.327779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:23.335529 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b9800f22-7712-4c65-b816-394d9baba2d8 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.159072 Aug 08 18:13:23.336086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 317/614] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:23 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:24.357480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:24.358574 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:24.365201 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:24.365676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:24.366104 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:24.366781 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:24.367228 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:24.367641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:24.499613 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:24.508398 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e0ff40f-cc0e-4848-a4f3-dbd72b4cb409 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.155058 Aug 08 18:13:24.509005 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 298/615] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:24 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:25.530938 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:25.531518 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:25.538207 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:25.538664 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:25.539091 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:25.539765 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:25.540213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:25.540665 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:25.667086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:25.674897 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-971c5680-e3da-46f0-b588-0ceef9b24636 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.148650 Aug 08 18:13:25.675455 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 318/616] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:25 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:26.407649 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:26.408225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:26.415505 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:26.415996 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:26.416433 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:26.417432 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:26.418038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:26.418472 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:26.447372 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8e851f7e-7dc2-48ba-bcb9-4cfe7e5bb46e tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments/2c9fc8d6-484a-4f93-9498-ed25dc5cab3d" status: 200 len: 194 microversion: 2.20 time: 0.044032 Aug 08 18:13:26.447946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 299/617] 10.222.0.50 () {60 vars in 1454 bytes} [Mon Aug 8 18:13:26 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments/2c9fc8d6-484a-4f93-9498-ed25dc5cab3d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:13:26.513737 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:26.514259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:26.520160 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:26.520679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:26.521110 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:26.521787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:26.522237 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:26.522656 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:26.600178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lazy-loading 'services' on Instance uuid 87c18185-5443-4967-832b-8cec6d6aa044 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:13:26.695450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:26.696025 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:26.703157 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:26.703850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:26.704700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:26.705890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:26.706364 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:26.706793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:26.760436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-265c3a67-5be4-4290-9c05-fc7b9e0f1d1d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments/2c9fc8d6-484a-4f93-9498-ed25dc5cab3d" status: 202 len: 0 microversion: 2.20 time: 0.250329 Aug 08 18:13:26.761332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 319/618] 10.222.0.50 () {60 vars in 1457 bytes} [Mon Aug 8 18:13:26 2022] DELETE /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments/2c9fc8d6-484a-4f93-9498-ed25dc5cab3d => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:13:26.770226 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:26.772625 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:26.780150 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:26.780677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:26.781111 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:26.781804 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:26.782255 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:26.782671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:26.814918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-aa39b60f-8843-4c53-815c-67633b4d1864 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049099 Aug 08 18:13:26.815492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 320/619] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 18:13:26 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:13:26.842838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:26.851788 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dfa53b56-5322-4b93-9460-56707ce2a22c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.160243 Aug 08 18:13:26.852356 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 300/620] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:26 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:13:27.828287 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:27.830544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:27.836877 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:27.837353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:27.837799 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:27.838483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:27.838931 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:27.839353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:27.867914 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-90019ce4-e1f7-40f3-b85d-4421e51cc2c5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044406 Aug 08 18:13:27.868395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 321/621] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 18:13:27 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:13:27.875110 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:27.882064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:27.882379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:27.882894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:27.883314 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:27.884080 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:27.884618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:27.885051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:28.014343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:28.022725 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bf8909e2-9806-467b-aaab-1da8ab7cae01 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.152216 Aug 08 18:13:28.023309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 301/622] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:27 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:28.880256 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:28.882421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:28.888813 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:28.889785 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:28.890221 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:28.890913 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:28.891367 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:28.891790 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:28.921591 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0de3c356-24ad-4fa6-b662-5d37d9ca7c48 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045291 Aug 08 18:13:28.922146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 322/623] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 18:13:28 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:28.982258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:28.982771 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:28.989128 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:28.989610 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:28.990047 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:28.990737 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:28.991230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:28.991655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:29.016795 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:13:29.043754 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:29.044354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:29.050677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:29.051155 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:29.051587 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:29.052266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:29.052789 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:29.053153 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:29.181021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:29.189685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bf56cadc-51a4-40b0-8135-450c5673e4e0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.149647 Aug 08 18:13:29.190250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 323/624] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:29 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:13:29.286602 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-220ea7f4-9fa5-4221-8a2d-449cdb59326b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 204 len: 0 microversion: 2.20 time: 0.307859 Aug 08 18:13:29.287193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 302/625] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Aug 8 18:13:28 2022] DELETE /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 18:13:29.295358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:29.296052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:29.302598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:29.303133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:29.303558 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:29.304244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:29.304739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:29.308324 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:29.441564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:29.449466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:29.450981 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:29.452449 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e26bfdd7-2b12-40d0-b456-96fbba3cbea9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.160962 Aug 08 18:13:29.457266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 324/626] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:29 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:30.211676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:30.212312 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:30.219498 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:30.219984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:30.220426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:30.221159 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:30.221617 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:30.222041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:30.351893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:30.360279 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-89ddd02e-19e6-4782-a873-72043072dcde tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.152857 Aug 08 18:13:30.360877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 303/627] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:30 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:30.474742 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:30.475282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:30.481834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:30.482354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:30.482796 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:30.483490 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:30.483970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:30.484395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:30.615039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:30.622847 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:30.624869 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:30.626022 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-90a38283-5085-4a36-ae1c-ac02246b8803 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.155258 Aug 08 18:13:30.626577 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 325/628] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:30 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:31.383321 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:31.384070 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:31.393297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:31.393853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:31.394663 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:31.395562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:31.396374 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:31.397081 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:31.624260 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:31.632164 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-85fca677-14a1-40c7-b295-2dd96184e1f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.254301 Aug 08 18:13:31.632762 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 304/629] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:31 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:31.649936 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:31.650562 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:31.657565 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:31.658060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:31.658504 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:31.659195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:31.659714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:31.660143 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:31.883242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:31.891636 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:31.893202 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:31.894359 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1c94df1e-3bf9-467e-8904-14049d15330d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1724 microversion: 2.20 time: 0.248362 Aug 08 18:13:31.894917 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 326/630] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:31 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:32.336696 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-d315a38d-3313-4b36-aebc-6d4d79100c71 req-047334b6-bb28-4035-8c57-19b85b8b5929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c18185-5443-4967-832b-8cec6d6aa044", "name": "network-vif-deleted", "tag": "364cbc31-b2c9-4de9-a7cd-715d07c15ee5"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:32.346376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d315a38d-3313-4b36-aebc-6d4d79100c71 req-047334b6-bb28-4035-8c57-19b85b8b5929 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:32.346857 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d315a38d-3313-4b36-aebc-6d4d79100c71 req-047334b6-bb28-4035-8c57-19b85b8b5929 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:32.347294 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d315a38d-3313-4b36-aebc-6d4d79100c71 req-047334b6-bb28-4035-8c57-19b85b8b5929 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:32.358863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-d315a38d-3313-4b36-aebc-6d4d79100c71 req-047334b6-bb28-4035-8c57-19b85b8b5929 service nova] Creating event network-vif-deleted:364cbc31-b2c9-4de9-a7cd-715d07c15ee5 for instance 87c18185-5443-4967-832b-8cec6d6aa044 on hv-cinder-85236 Aug 08 18:13:32.363764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-d315a38d-3313-4b36-aebc-6d4d79100c71 req-047334b6-bb28-4035-8c57-19b85b8b5929 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030910 Aug 08 18:13:32.364353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 305/631] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:32.654058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:32.654681 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:32.661812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:32.662426 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:32.663020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:32.663822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:32.664329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:32.664840 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:32.821816 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:32.830101 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-632c356b-ca7d-4a77-bb2a-7ba9001ce733 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.179839 Aug 08 18:13:32.837971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 327/632] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:32 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:32.918847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:32.919467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:32.926313 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:32.926801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:32.927245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:32.927940 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:32.928400 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:32.928855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:32.959709 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:32.960198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:32.960746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:32.961197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lazy-loading 'fault' on Instance uuid 87c18185-5443-4967-832b-8cec6d6aa044 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:13:33.007749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:33.016141 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:33.017734 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:33.018914 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-27196568-5794-405e-be15-33135a47bd76 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1370 microversion: 2.20 time: 0.105032 Aug 08 18:13:33.019479 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 306/633] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:32 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:33.852228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:33.852872 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:33.859282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:33.864344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:33.864344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:33.864344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:33.864344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:33.864768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:33.997329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:34.006035 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-902e0288-5cdb-4880-889e-74dfff4c9717 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1735 microversion: 2.1 time: 0.157603 Aug 08 18:13:34.006635 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 328/634] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:33 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:34.042195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:34.042835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:34.049551 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:34.053427 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:34.053427 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:34.053427 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:34.053427 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:34.053815 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:34.083399 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:34.083885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:34.084347 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:34.084826 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lazy-loading 'fault' on Instance uuid 87c18185-5443-4967-832b-8cec6d6aa044 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:13:34.125594 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:34.133800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:34.134715 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:34.135875 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7c08fb43-ae38-4917-99a7-4ab4851875c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 200 len: 1370 microversion: 2.20 time: 0.097770 Aug 08 18:13:34.136426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 307/635] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:34 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:35.027926 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:35.028558 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:35.035685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.036183 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.036644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.037342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.037816 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.038220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.159365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:35.159979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:35.165501 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:35.166624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.167110 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.167559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.168249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.168741 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.169165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.174075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2e15536f-bf2a-4787-91da-54048327bc28 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1715 microversion: 2.1 time: 0.150004 Aug 08 18:13:35.174649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 329/636] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:35 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:35.182890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] HTTP exception thrown: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Request method failure captured: Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 HTTP/1.1 Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VFEzX6MiZ2KM-AwQaXPHdD3kamzNfdhJ4oizldk4bcvl9c57wWkdtmepNHMvHGTgf_dqbNNQEgIaaMxPJ49SzUcrnil7hZyG5bAZGVEAw-Gi9WutCBbSPVf9-gel3_GSDt-4lO4SHPYoFCKBIEyn3kMlIk0FYrMKqEw23vfEndXA0E Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:13:35.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf197791c8734703b20784498cd8dcd5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2ec53f935a6c41f2af67e9fd2e13e12c Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:13:35.186248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '87c18185-5443-4967-832b-8cec6d6aa044'} Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:13:35.187417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:13:35.188985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.190383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Returning 404 to user: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:13:35.190383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-adb58d9f-bfa2-49b6-861f-6fc26981f542 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 404 len: 111 microversion: 2.20 time: 0.031041 Aug 08 18:13:35.190383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 308/637] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:35 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 18:13:35.194562 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-372e4af0-0677-40ed-8915-19c753596777 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '.version_select at 0x7f21ac503160>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:35.276388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-372e4af0-0677-40ed-8915-19c753596777 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887107204" status: 204 len: 0 microversion: 2.20 time: 0.085414 Aug 08 18:13:35.277094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 330/638] 10.222.0.50 () {60 vars in 1259 bytes} [Mon Aug 8 18:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887107204 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 18:13:35.280379 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:35.280989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:35.287085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.290430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.290430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.290430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.290430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.290850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.372742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] HTTP exception thrown: Cannot 'detach_volume' instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 while it is in vm_state rescued Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Request method failure captured: Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments/38d05c4a-8b63-4dd7-8541-aea77d415513 HTTP/1.1 Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VFBJBvNIm8XO1o8nN70rM82JzCWThocYUlsFdB_3inGl2Ht2Ok5s6cLQPQm16uUMwEw_YZovD4MX6nOwbs-9NOtLX3YCSTDvhVzznPguIbY9onCuhox29kZtgl8DnU-CYK2a7fiU_F3st4_DuOuelqdgPGett66k1D1zpaEJHLz88E Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:13:35.374273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_34b812a3f98747eeac35fbc27a342ab0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 4c7a6c1d08554db09d65394ec338f8b5 Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:13:35.375961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Cannot 'detach_volume' instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 while it is in vm_state rescued Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'server_id': 'ca3a285c-f9d9-4be0-b67e-94e7a7eee516', 'id': '38d05c4a-8b63-4dd7-8541-aea77d415513'} Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:13:35.376761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 while it is in vm_state rescued Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 while it is in vm_state rescued Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:13:35.378239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Returning 409 to user: Cannot 'detach_volume' instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 while it is in vm_state rescued {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:13:35.379401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c4383109-f7e6-48e1-a079-d58ba5217c43 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments/38d05c4a-8b63-4dd7-8541-aea77d415513" status: 409 len: 152 microversion: 2.1 time: 0.099851 Aug 08 18:13:35.379401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 309/639] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:13:35 2022] DELETE /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments/38d05c4a-8b63-4dd7-8541-aea77d415513 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 08 18:13:35.384529 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:35.385123 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:35.391525 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.392004 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.392439 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.393170 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.394634 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.395059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.621531 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-45a4ee32-1e87-4a21-a8ec-68f8b6d12492 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "POST /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/action" status: 202 len: 0 microversion: 2.1 time: 0.240701 Aug 08 18:13:35.622434 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 331/640] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:13:35 2022] POST /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:13:35.630332 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:35.631008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:35.637062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.637637 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.638154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.639579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:35.640105 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:35.640635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:35.923541 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:35.931952 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c4e554e9-6fa7-48ea-8ee4-781956fb2ac9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1723 microversion: 2.1 time: 0.305447 Aug 08 18:13:35.932521 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 310/641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:35 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:36.343498 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6a7fddb9-e2e8-458e-91e3-63a92a3c96be tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'create', calling method: .version_select at 0x7f21ac566f70>, body: {"keypair": {"name": "tempest-keypair-874715701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDApfGlXgJwqB3yh9Rrd+uokdPaVgmeobRcjCS6ek2CwFM8tZfT6D1vgzKhY4V8FUj79bNVxAyhT/pWFPHWsPgj1ZOGtbUR7Ie/rS5vWl8upDQ/8qy0AXHv69Ew4WjmeYg=="}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:36.359242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-6a7fddb9-e2e8-458e-91e3-63a92a3c96be tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Getting quotas for project cf197791c8734703b20784498cd8dcd5. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:13:36.363952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-6a7fddb9-e2e8-458e-91e3-63a92a3c96be tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Getting quotas for user 2ec53f935a6c41f2af67e9fd2e13e12c and project cf197791c8734703b20784498cd8dcd5. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:13:36.442603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6a7fddb9-e2e8-458e-91e3-63a92a3c96be tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.103641 Aug 08 18:13:36.443138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 332/642] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Aug 8 18:13:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 18:13:36.954178 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:36.954792 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:36.961239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:36.961717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:36.962151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:36.962874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:36.963328 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:36.963749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:37.098862 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:37.106962 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6435b38f-625e-4490-b4c7-567fcb5b04f7 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1723 microversion: 2.1 time: 0.157241 Aug 08 18:13:37.113254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 311/643] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:36 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:38.128040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:38.128797 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:38.136333 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:38.136969 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:38.137406 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:38.138095 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:38.138547 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:38.139050 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:38.287211 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:38.290387 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-10ad773d-a10c-4dec-b4dc-f3a9fa7378d2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1723 microversion: 2.1 time: 0.166215 Aug 08 18:13:38.290961 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 333/644] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:38 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:38.667511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2012061660", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bef90788-2838-4cee-90da-10599bd32eb9"}], "security_groups": [{"name": "tempest-securitygroup--1279600533"}], "key_name": "tempest-keypair-874715701", "user_data": "}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:38.774878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] validate_networks() for [('bef90788-2838-4cee-90da-10599bd32eb9', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:13:38.944862 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:39.313737 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:39.314384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:39.321107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:39.321599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:39.322036 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:39.322735 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:39.323191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:39.323614 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:39.326400 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:39.408418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:13:39.409003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:13:39.409477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:13:39.409881 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:13:39.410455 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:13:39.421258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:39.421258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:39.421258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:39.421608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:39.421997 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:39.422422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:39.441130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Getting quotas for project cf197791c8734703b20784498cd8dcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:13:39.445547 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Getting quotas for user 2ec53f935a6c41f2af67e9fd2e13e12c and project cf197791c8734703b20784498cd8dcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:13:39.456919 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:13:39.459177 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:13:39.471829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:39.479873 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a2520972-e368-445c-8bda-d6b04d00362d tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1729 microversion: 2.1 time: 0.170675 Aug 08 18:13:39.480441 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 334/645] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:39 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:13:39.501883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:39.502368 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:39.508295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:39.508819 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:39.510241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:39.510241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:39.510422 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:39.510879 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:39.563258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e83ebcb8-9f13-428e-bfaa-7eacf45a7775 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.900124 Aug 08 18:13:39.564275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 312/646] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Aug 8 18:13:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 18:13:39.575892 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d50f9224-3e56-444f-8d71-9224bb8a5a6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:39.576497 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d50f9224-3e56-444f-8d71-9224bb8a5a6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:39.596099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-180caefa-7826-48c0-b219-3bd62c335828 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098203 Aug 08 18:13:39.597089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 335/647] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 18:13:39 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:39.630833 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d50f9224-3e56-444f-8d71-9224bb8a5a6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:39.638951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d50f9224-3e56-444f-8d71-9224bb8a5a6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:39.640470 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d50f9224-3e56-444f-8d71-9224bb8a5a6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:39.641591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d50f9224-3e56-444f-8d71-9224bb8a5a6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1281 microversion: 2.20 time: 0.069739 Aug 08 18:13:39.652991 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 313/648] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:39 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:40.602941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-e2fd730b-75b1-47d8-8d37-c8769ee18608 req-e14f0356-2089-4a29-98c5-1ab65e15eb67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3a285c-f9d9-4be0-b67e-94e7a7eee516", "tag": "304be941-82c9-4c43-a117-34baa084b8dd"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:40.619885 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e2fd730b-75b1-47d8-8d37-c8769ee18608 req-e14f0356-2089-4a29-98c5-1ab65e15eb67 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:40.620539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e2fd730b-75b1-47d8-8d37-c8769ee18608 req-e14f0356-2089-4a29-98c5-1ab65e15eb67 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:40.621469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e2fd730b-75b1-47d8-8d37-c8769ee18608 req-e14f0356-2089-4a29-98c5-1ab65e15eb67 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:40.633676 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-e2fd730b-75b1-47d8-8d37-c8769ee18608 req-e14f0356-2089-4a29-98c5-1ab65e15eb67 service nova] Creating event network-changed:304be941-82c9-4c43-a117-34baa084b8dd for instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 on hv-cinder-85236 Aug 08 18:13:40.638770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-e2fd730b-75b1-47d8-8d37-c8769ee18608 req-e14f0356-2089-4a29-98c5-1ab65e15eb67 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041393 Aug 08 18:13:40.639879 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 336/649] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:40.663273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:40.663877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:40.670664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:40.671147 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:40.671577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:40.672271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:40.672871 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:40.673350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:40.772173 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:40.782363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:40.784402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:40.785947 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-198376a3-8e6d-4665-81c5-24e228f1726b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1277 microversion: 2.20 time: 0.126623 Aug 08 18:13:40.786676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 314/650] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:40 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:41.805062 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:41.807400 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:41.811955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:41.812765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:41.817278 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:41.818014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:41.818623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:41.819506 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:41.820117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:41.820705 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:41.820912 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:41.821396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:41.822123 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:41.823023 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:41.823747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:41.824419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:41.831302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:41.861619 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8666a7f1-8188-4f09-b540-387c7c5ff5a4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060550 Aug 08 18:13:41.863634 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 337/651] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:13:41 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 18:13:41.904418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:41.915536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:41.917118 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:41.918388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f4a203da-47b8-4fd8-8695-438554e1bc75 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1351 microversion: 2.20 time: 0.113015 Aug 08 18:13:41.919167 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 315/652] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:41 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:41.935145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:41.935567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:41.942223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:41.942703 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:41.943135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:41.943818 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:41.944270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:41.944723 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:41.971720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Going to try to terminate instance {{(pid=118382) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:13:42.276992 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-561fb660-6e4c-4d8e-8b69-5fa0b32ef33c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 204 len: 0 microversion: 2.1 time: 0.345382 Aug 08 18:13:42.277620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 338/653] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:13:41 2022] DELETE /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:13:42.286307 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:42.286914 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:42.293354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:42.293844 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:42.294280 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:42.294973 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:42.295920 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:42.296391 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:42.506718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:42.520671 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d567bf0f-00e3-4d6b-8241-f58f51aa1cc0 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1675 microversion: 2.1 time: 0.238425 Aug 08 18:13:42.521533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 316/654] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:42 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:42.655242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-0cc6aebc-c843-4391-9df9-807a1e439460 req-f61796fc-cb70-47f8-9eaf-364f945afd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3a285c-f9d9-4be0-b67e-94e7a7eee516", "tag": "304be941-82c9-4c43-a117-34baa084b8dd"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:42.664283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0cc6aebc-c843-4391-9df9-807a1e439460 req-f61796fc-cb70-47f8-9eaf-364f945afd4f service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:42.664824 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0cc6aebc-c843-4391-9df9-807a1e439460 req-f61796fc-cb70-47f8-9eaf-364f945afd4f service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:42.665253 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0cc6aebc-c843-4391-9df9-807a1e439460 req-f61796fc-cb70-47f8-9eaf-364f945afd4f service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:42.677026 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-0cc6aebc-c843-4391-9df9-807a1e439460 req-f61796fc-cb70-47f8-9eaf-364f945afd4f service nova] Creating event network-changed:304be941-82c9-4c43-a117-34baa084b8dd for instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 on hv-cinder-85236 Aug 08 18:13:42.681741 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-0cc6aebc-c843-4391-9df9-807a1e439460 req-f61796fc-cb70-47f8-9eaf-364f945afd4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031160 Aug 08 18:13:42.682328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 339/655] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:42.941620 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:42.942230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:42.948696 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:42.949179 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:42.949613 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:42.950298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:42.950751 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:42.951169 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:43.081613 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:43.089519 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:43.091136 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:43.092880 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-20bc6054-3533-4b28-92e5-2f869f07b037 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.154505 Aug 08 18:13:43.093426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 317/656] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:42 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:43.543262 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:43.543876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:43.550696 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:43.551171 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:43.551605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:43.552280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:43.552760 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:43.553182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:43.680002 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:43.687492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3bed32a2-7a94-4048-95a1-4ae3b0443065 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1675 microversion: 2.1 time: 0.148913 Aug 08 18:13:43.688062 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 340/657] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:43 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:44.115251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:44.115869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:44.122359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:44.122835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:44.123750 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:44.124430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:44.124906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:44.125510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:44.251036 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:44.258921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:44.260412 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:44.261533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e4bacc01-c78e-485b-85bb-58e7a5de9e8d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.150299 Aug 08 18:13:44.262093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 318/658] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:44 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:44.713111 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:44.714463 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:44.721703 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:44.722120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:44.722547 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:44.723246 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:44.723678 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:44.724212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:44.989692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:44.998332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-dcfada56-4c91-4a87-ba6e-622bc55b9c7c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1675 microversion: 2.1 time: 0.289047 Aug 08 18:13:44.999114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 341/659] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:44 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:45.287280 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:45.288408 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:45.294873 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:45.295838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:45.296271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:45.297200 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:45.297651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:45.300144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:45.603514 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:45.618188 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:45.622154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:45.624732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9f80a241-c162-44d0-a8cd-97d96b3d8532 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.343989 Aug 08 18:13:45.627132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 319/660] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:45 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:45.683331 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-e7e8525c-49b5-44ae-86f8-6d295f350fc8 req-6eb5609e-ec95-498a-be47-93e7e4c71ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce432ca-7675-48f3-96a4-55aebc18503d", "tag": "7cc61064-033f-47bf-8688-67f7559828a2"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:45.695279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e7e8525c-49b5-44ae-86f8-6d295f350fc8 req-6eb5609e-ec95-498a-be47-93e7e4c71ab3 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:45.696068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e7e8525c-49b5-44ae-86f8-6d295f350fc8 req-6eb5609e-ec95-498a-be47-93e7e4c71ab3 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:45.696794 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e7e8525c-49b5-44ae-86f8-6d295f350fc8 req-6eb5609e-ec95-498a-be47-93e7e4c71ab3 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:45.712193 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-e7e8525c-49b5-44ae-86f8-6d295f350fc8 req-6eb5609e-ec95-498a-be47-93e7e4c71ab3 service nova] Creating event network-changed:7cc61064-033f-47bf-8688-67f7559828a2 for instance 5ce432ca-7675-48f3-96a4-55aebc18503d on hv-cinder-85236 Aug 08 18:13:45.718910 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-e7e8525c-49b5-44ae-86f8-6d295f350fc8 req-6eb5609e-ec95-498a-be47-93e7e4c71ab3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040019 Aug 08 18:13:45.720350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 342/661] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:45.941668 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-de744319-6d48-49fb-b733-977512ae761c req-a42fe9d5-4ced-4bf2-bdba-760bcf5d3d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d934484-9583-4162-bd95-ff93c9ff9372", "name": "network-vif-deleted", "tag": "d61b8086-48eb-489f-b933-64bad8582780"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:45.952676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-de744319-6d48-49fb-b733-977512ae761c req-a42fe9d5-4ced-4bf2-bdba-760bcf5d3d19 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:45.952938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-de744319-6d48-49fb-b733-977512ae761c req-a42fe9d5-4ced-4bf2-bdba-760bcf5d3d19 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:45.953609 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-de744319-6d48-49fb-b733-977512ae761c req-a42fe9d5-4ced-4bf2-bdba-760bcf5d3d19 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:45.965779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-de744319-6d48-49fb-b733-977512ae761c req-a42fe9d5-4ced-4bf2-bdba-760bcf5d3d19 service nova] Creating event network-vif-deleted:d61b8086-48eb-489f-b933-64bad8582780 for instance 2d934484-9583-4162-bd95-ff93c9ff9372 on hv-cinder-85236 Aug 08 18:13:45.971807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-de744319-6d48-49fb-b733-977512ae761c req-a42fe9d5-4ced-4bf2-bdba-760bcf5d3d19 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034052 Aug 08 18:13:45.972793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 320/662] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:46.021192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:46.022193 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:46.032483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:46.033788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:46.034188 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:46.035753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:46.036284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:46.037381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:46.110675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:46.120073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-dd12974a-b968-4e28-9a38-e78ca2723b20 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 200 len: 1322 microversion: 2.1 time: 0.103619 Aug 08 18:13:46.125045 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 343/663] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:46 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 1322 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:46.651262 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:46.652001 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:46.659482 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:46.659978 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:46.660457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:46.661240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:46.661648 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:46.662181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:46.885191 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:46.895919 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:46.897699 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:46.898947 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9588453d-5067-457c-959b-5e0fc21d365d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.252636 Aug 08 18:13:46.899591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 321/664] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:46 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:47.142774 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:47.143294 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:47.145248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=4 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:47.150401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:47.150884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:47.151318 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:47.152002 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:47.152453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:47.152902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:47.165729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] HTTP exception thrown: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Request method failure captured: Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 HTTP/1.1 Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFB2aP0d-tmHv9AIMpSDq23E4e3i0ZCrnrXcvNeD4l9XlxeB2npYYpGrr62VxEXJePllCtUF3dOhlaPMwIrKXCwxCdJee6oSJ8GqDZBNbKAvUjMjmJJpmo7DdEJzF1JeD7022Lp2FPU6O3lb8lkGX6gpdXkXzE8WQS5KQ3q0i9Tjdk Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:13:47.167312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5de58eb192de494b809a04e638e2a291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5de58eb192de494b809a04e638e2a291", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: caf8d88ca4da4515bd9f1bec64da3375 Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:13:47.168990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '2d934484-9583-4162-bd95-ff93c9ff9372'} Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:13:47.170014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:13:47.171515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:47.172875 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Returning 404 to user: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:13:47.172875 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-10fac6a6-bd25-4860-af02-b9e3ca595c2d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 404 len: 111 microversion: 2.1 time: 0.030442 Aug 08 18:13:47.172875 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 344/665] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:47 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:13:47.177851 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e86a4e8f-a067-4607-a34c-53c4c72bacf1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '.version_select at 0x7f21acff7940>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:47.293549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e86a4e8f-a067-4607-a34c-53c4c72bacf1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049019407" status: 202 len: 0 microversion: 2.1 time: 0.119610 Aug 08 18:13:47.294115 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 322/666] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 18:13:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049019407 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:13:47.866302 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2129168382"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:47.866828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:47.872781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:47.873269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:47.873697 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:47.874374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:47.874820 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:47.875236 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:47.926770 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:47.927369 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:47.933921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:47.934404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:47.934839 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:47.935572 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:47.935987 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:47.936412 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:48.083163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.network.security_group_api [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Removing security group 3759a092-b0e4-4161-9fd3-7c59f09f7b19 from port d266e64e-9c90-4916-b8ce-ab1d6acfc3fe Aug 08 18:13:48.242941 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:48.252211 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:48.253796 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:48.254919 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e6e2e632-24d9-4ec8-9b16-3b6341671ac8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.332751 Aug 08 18:13:48.255513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 323/667] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:47 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:48.260165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-417cebe3-31f6-4a44-84b6-b1c5b70080c7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'create', calling method: .version_select at 0x7f21ace38550>, body: {"keypair": {"name": "tempest-keypair-1415172423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHozOuhfNXXT7q9t8Ev4bu2lTctQ27llxVpJab2AeirDQIb5rYRwaFJpHaHiGyMgWLe15uXjtv80FmUH629SO6xzeuKOBL81sCIKSBEcSFn9mkmQD42Vx2KN5ucfcfbN2Q=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:48.275918 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-417cebe3-31f6-4a44-84b6-b1c5b70080c7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Getting quotas for project 5de58eb192de494b809a04e638e2a291. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:13:48.280578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-417cebe3-31f6-4a44-84b6-b1c5b70080c7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Getting quotas for user caf8d88ca4da4515bd9f1bec64da3375 and project 5de58eb192de494b809a04e638e2a291. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:13:48.334350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-417cebe3-31f6-4a44-84b6-b1c5b70080c7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077624 Aug 08 18:13:48.334883 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 324/668] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:13:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:48.529167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c1fd2bd3-76e2-4149-a59a-324bb5ca869e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "POST /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/action" status: 202 len: 0 microversion: 2.1 time: 0.667110 Aug 08 18:13:48.529847 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 345/669] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:13:47 2022] POST /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:13:48.538660 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-c4ee7938-a52b-40d9-bf7f-109652e15622 req-d80a3a53-03af-4515-b945-1a41db736e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc0adbbe-a03d-4b75-99d2-5a8f9c36567b", "tag": "d266e64e-9c90-4916-b8ce-ab1d6acfc3fe"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:48.549778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c4ee7938-a52b-40d9-bf7f-109652e15622 req-d80a3a53-03af-4515-b945-1a41db736e4e service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:48.549778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c4ee7938-a52b-40d9-bf7f-109652e15622 req-d80a3a53-03af-4515-b945-1a41db736e4e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:48.550071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c4ee7938-a52b-40d9-bf7f-109652e15622 req-d80a3a53-03af-4515-b945-1a41db736e4e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:48.562899 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-c4ee7938-a52b-40d9-bf7f-109652e15622 req-d80a3a53-03af-4515-b945-1a41db736e4e service nova] Creating event network-changed:d266e64e-9c90-4916-b8ce-ab1d6acfc3fe for instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b on hv-cinder-85236 Aug 08 18:13:48.567717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-c4ee7938-a52b-40d9-bf7f-109652e15622 req-d80a3a53-03af-4515-b945-1a41db736e4e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032926 Aug 08 18:13:48.568587 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 325/670] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:49.283989 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:49.285011 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:49.292554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:49.293199 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:49.293908 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:49.295033 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:49.296437 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:49.297214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:49.568148 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:49.579650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:49.581413 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:49.583054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9bd15c38-f9e8-40ac-a4ae-404615d45181 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.304022 Aug 08 18:13:49.583732 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 346/671] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:49 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:49.597323 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:49.601863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:49.602450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:49.608856 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:49.609586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:49.610249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:49.611132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:49.611753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:49.612342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:49.638220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-658b3d45-ba54-452f-af22-e99a9710c9c3 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/ips" status: 200 len: 148 microversion: 2.1 time: 0.042302 Aug 08 18:13:49.645411 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 326/672] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:13:49 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:49.896174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:49.896721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:49.906692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:49.914640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-adf5a32f-4fc4-4390-91ef-06648e40cdf4 req-51f290e3-99ca-4d65-b87e-670b6e985c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc0adbbe-a03d-4b75-99d2-5a8f9c36567b", "tag": "d266e64e-9c90-4916-b8ce-ab1d6acfc3fe"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:49.925203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:49.925812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:49.926650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:49.927750 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:49.928237 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:49.932079 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-adf5a32f-4fc4-4390-91ef-06648e40cdf4 req-51f290e3-99ca-4d65-b87e-670b6e985c38 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:49.937008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-adf5a32f-4fc4-4390-91ef-06648e40cdf4 req-51f290e3-99ca-4d65-b87e-670b6e985c38 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:49.937522 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-adf5a32f-4fc4-4390-91ef-06648e40cdf4 req-51f290e3-99ca-4d65-b87e-670b6e985c38 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:49.949197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-adf5a32f-4fc4-4390-91ef-06648e40cdf4 req-51f290e3-99ca-4d65-b87e-670b6e985c38 service nova] Creating event network-changed:d266e64e-9c90-4916-b8ce-ab1d6acfc3fe for instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b on hv-cinder-85236 Aug 08 18:13:49.954912 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-adf5a32f-4fc4-4390-91ef-06648e40cdf4 req-51f290e3-99ca-4d65-b87e-670b6e985c38 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046845 Aug 08 18:13:49.955911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 327/673] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:50.043515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lazy-loading 'services' on Instance uuid fc0adbbe-a03d-4b75-99d2-5a8f9c36567b {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:13:50.230856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cff7e0eb-4245-4899-b3e6-66c819609e7c tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments/b90f5f62-7eeb-435f-bb42-df5af73bb6a2" status: 202 len: 0 microversion: 2.1 time: 0.338716 Aug 08 18:13:50.236068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 347/674] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:13:49 2022] DELETE /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments/b90f5f62-7eeb-435f-bb42-df5af73bb6a2 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:13:50.245084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:50.258801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:50.272094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:50.272754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:50.274373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:50.274373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:50.274624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:50.274921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:50.307913 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5d5fc9f4-3db0-407b-a201-281ae7f2e95e tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071106 Aug 08 18:13:50.308926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 328/675] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:13:50 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:50.608606 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:50.609428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:50.615909 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:50.616582 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:50.617266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:50.618099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:50.618783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:50.619384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:50.789829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:50.798849 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:50.800386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:50.801551 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f2ff3db3-b086-4edc-9157-d68b3ab71b0a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.200034 Aug 08 18:13:50.803138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 348/676] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:50 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:51.318026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b7eb597-6924-4d66-94f5-d12857df6bb2"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:51.320326 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:51.321140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:51.323319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:51.325265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:51.327756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:51.328245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:51.328745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:51.329441 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:51.329930 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:51.330342 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:51.330798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:51.331202 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:51.331630 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:51.332306 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:51.332778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:51.333189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:51.362971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-49cf8d2b-1db4-406c-aebf-993e96fd3381 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Aug 08 18:13:51.365121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 349/677] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:13:51 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:13:51.442524 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1742330978", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36707abe-d83a-41b8-9f1e-6bcbe70a5bd4"}], "security_groups": [{"name": "tempest-securitygroup--895508259"}], "key_name": "tempest-keypair-1415172423", "user_data": "}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:51.720204 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] validate_networks() for [('36707abe-d83a-41b8-9f1e-6bcbe70a5bd4', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:13:52.080906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-82e9cc2f-bf35-46dd-a89f-25c3205e7929 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766648 Aug 08 18:13:52.081659 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 329/678] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:13:51 2022] POST /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:52.087869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:52.089116 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:52.098513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.099309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.099753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.100678 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.101650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.102518 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.131461 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:13:52.133515 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:13:52.134409 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:13:52.135123 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:13:52.136220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:13:52.154889 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.155382 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.155844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.156629 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.157086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.157508 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.174896 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Getting quotas for project 5de58eb192de494b809a04e638e2a291. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:13:52.178884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Getting quotas for user caf8d88ca4da4515bd9f1bec64da3375 and project 5de58eb192de494b809a04e638e2a291. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:13:52.190714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:13:52.193059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:13:52.243615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:52.251674 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:52.253266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:52.254456 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ebfc8992-d76e-4394-a253-bc44d6d50eab tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.171524 Aug 08 18:13:52.255010 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 330/679] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:52 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:52.259451 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-10421431-f309-4937-b41f-ba6d89372898 req-d8812b30-3048-4780-9924-cf8557f0cc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce432ca-7675-48f3-96a4-55aebc18503d", "name": "network-vif-plugged", "status": "completed", "tag": "7cc61064-033f-47bf-8688-67f7559828a2"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:52.270787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-10421431-f309-4937-b41f-ba6d89372898 req-d8812b30-3048-4780-9924-cf8557f0cc0b service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.271300 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-10421431-f309-4937-b41f-ba6d89372898 req-d8812b30-3048-4780-9924-cf8557f0cc0b service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.271731 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-10421431-f309-4937-b41f-ba6d89372898 req-d8812b30-3048-4780-9924-cf8557f0cc0b service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.281169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-74c15002-d5dd-48ec-9b0c-08babda14531 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.842812 Aug 08 18:13:52.284369 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-10421431-f309-4937-b41f-ba6d89372898 req-d8812b30-3048-4780-9924-cf8557f0cc0b service nova] Creating event network-vif-plugged:7cc61064-033f-47bf-8688-67f7559828a2 for instance 5ce432ca-7675-48f3-96a4-55aebc18503d on hv-cinder-85236 Aug 08 18:13:52.288315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 350/680] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:13:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 18:13:52.289424 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-10421431-f309-4937-b41f-ba6d89372898 req-d8812b30-3048-4780-9924-cf8557f0cc0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033254 Aug 08 18:13:52.290191 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 331/681] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:52.293567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cf677138-6595-4f9c-8b3e-072047e40b98 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:52.294158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cf677138-6595-4f9c-8b3e-072047e40b98 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:52.351129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cf677138-6595-4f9c-8b3e-072047e40b98 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:52.359763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cf677138-6595-4f9c-8b3e-072047e40b98 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1238 microversion: 2.1 time: 0.070255 Aug 08 18:13:52.360329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 351/682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:52 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:52.380026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:52.382308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:52.388689 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.389011 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.389453 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.390205 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.390750 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.391008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.422389 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-67051f75-6ea7-4268-a356-9c73cbca7864 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046709 Aug 08 18:13:52.424823 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 332/683] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:13:52 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:13:52.433876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:52.434932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:52.441885 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.442663 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.442818 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.443564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:52.444028 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:52.444455 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:52.525973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] HTTP exception thrown: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b is not attached to volume b90f5f62-7eeb-435f-bb42-df5af73bb6a2 Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Request method failure captured: Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments/b90f5f62-7eeb-435f-bb42-df5af73bb6a2 HTTP/1.1 Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VGuupI8RtIwpyhJbyYe8nPOgmxdkhckzP0dbwlZ7HdArux6AdJHCPx45d0MF3ViTaTDQIiAmwAkuMNERjSnTlnqMYbgPXL3LqghQZ0EaZso5m2daG6GJKgs4zWpG3NpP07qE3jrSMSoCfOgtL6JZe1dPsnqzDhkKLRjJyXMwFxcHQ4 Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c3b1914ba55849e4a3a55a20ed50e7a1 Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-TestMinimumBasicScenario-1905856392 Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:13:52.528328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3b1914ba55849e4a3a55a20ed50e7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3b1914ba55849e4a3a55a20ed50e7a1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3b1914ba55849e4a3a55a20ed50e7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3b1914ba55849e4a3a55a20ed50e7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-TestMinimumBasicScenario-1905856392 Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c3b1914ba55849e4a3a55a20ed50e7a1 Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1905856392 Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-TestMinimumBasicScenario-1905856392-project Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 6e4ebbf55d214dcc835e3f43876693bb Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-TestMinimumBasicScenario-1905856392-project Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:13:52.530519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b is not attached to volume b90f5f62-7eeb-435f-bb42-df5af73bb6a2 Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'server_id': 'fc0adbbe-a03d-4b75-99d2-5a8f9c36567b', 'id': 'b90f5f62-7eeb-435f-bb42-df5af73bb6a2'} Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b90f5f62-7eeb-435f-bb42-df5af73bb6a2. Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:13:52.531271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b is not attached to volume b90f5f62-7eeb-435f-bb42-df5af73bb6a2 Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b is not attached to volume b90f5f62-7eeb-435f-bb42-df5af73bb6a2 Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:52.532496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Returning 404 to user: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b is not attached to volume b90f5f62-7eeb-435f-bb42-df5af73bb6a2 {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:13:52.533542 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-534e13f0-aa08-4800-bbc4-5f41cfdd4764 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments/b90f5f62-7eeb-435f-bb42-df5af73bb6a2" status: 404 len: 154 microversion: 2.1 time: 0.100008 Aug 08 18:13:52.533542 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 352/684] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:13:52 2022] DELETE /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b/os-volume_attachments/b90f5f62-7eeb-435f-bb42-df5af73bb6a2 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:13:53.276131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:53.276804 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:53.283210 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:53.283694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:53.284134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:53.284884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:53.285416 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:53.285846 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:53.381212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:53.381852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:53.388036 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:53.388540 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:53.388975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:53.389676 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:53.390129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:53.390554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:53.405831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:53.419462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:53.429076 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:53.430547 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:53.433818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9e007694-aae6-4083-9b57-27184120e331 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1407 microversion: 2.20 time: 0.159471 Aug 08 18:13:53.433818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 333/685] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:53 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:13:53.454832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:53.462067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8d333011-d43b-491c-836a-2f3ce226d16c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1242 microversion: 2.1 time: 0.084665 Aug 08 18:13:53.462645 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 353/686] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:53 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:13:53.819984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:53.820485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:53.826508 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:53.827246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:53.827689 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:53.828377 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:53.828864 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:53.832951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:53.854333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:13:53.882847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:54.454929 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:54.455532 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:54.462574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:54.462966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:54.463395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:54.464073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:54.464533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:54.464958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:54.537824 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-361f52a7-b8d6-4d73-b79d-66e090cbde16 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 204 len: 0 microversion: 2.1 time: 0.721465 Aug 08 18:13:54.538726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 334/687] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:13:53 2022] DELETE /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:13:54.544487 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:54.545969 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:54.551792 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:54.552279 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:54.552989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:54.553697 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:54.554151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:54.554698 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:54.634637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:54.642406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:54.643743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:54.645294 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:54.651716 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ce82e970-c62a-4bcf-9697-735e4ee4b4a0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1599 microversion: 2.20 time: 0.196061 Aug 08 18:13:54.651716 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 354/688] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:13:54 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1599 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:13:54.652014 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fd0bc7e5-2536-426f-9d4a-248c950b9287 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1234 microversion: 2.1 time: 0.109679 Aug 08 18:13:54.652014 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 335/689] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:54 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1234 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:54.656874 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:54.657693 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:54.664025 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:54.667928 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:54.668437 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:54.669061 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:54.669191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:54.669551 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:54.669659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:54.670088 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:54.676682 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:54.677171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:54.677610 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:54.678309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:54.678822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:54.679248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:54.788140 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-12c2575a-7d47-4b2d-a47a-83776ba2e0c8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122825 Aug 08 18:13:54.788802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 336/690] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Aug 8 18:13:54 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 18:13:54.834384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:54.843123 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-58323726-7f39-4458-8fb5-b9c42408c9da tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1553 microversion: 2.1 time: 0.195151 Aug 08 18:13:54.843682 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 355/691] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:54 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:55.671746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:55.672544 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:55.678636 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:55.679125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:55.679561 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:55.680262 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:55.680776 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:55.681203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:55.746475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:55.755031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bcf5a5a2-4d0c-4096-8828-7500997ce3b5 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1290 microversion: 2.1 time: 0.088116 Aug 08 18:13:55.765454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 337/692] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:55 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:55.767631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-42029caf-292c-4478-a74c-ba810d57cd7a req-10381e8f-4d84-44d1-b9c9-d7c71caf4762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce432ca-7675-48f3-96a4-55aebc18503d", "tag": "7cc61064-033f-47bf-8688-67f7559828a2"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:55.777371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-42029caf-292c-4478-a74c-ba810d57cd7a req-10381e8f-4d84-44d1-b9c9-d7c71caf4762 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:55.777851 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-42029caf-292c-4478-a74c-ba810d57cd7a req-10381e8f-4d84-44d1-b9c9-d7c71caf4762 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:55.778271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-42029caf-292c-4478-a74c-ba810d57cd7a req-10381e8f-4d84-44d1-b9c9-d7c71caf4762 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:55.789714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-42029caf-292c-4478-a74c-ba810d57cd7a req-10381e8f-4d84-44d1-b9c9-d7c71caf4762 service nova] Creating event network-changed:7cc61064-033f-47bf-8688-67f7559828a2 for instance 5ce432ca-7675-48f3-96a4-55aebc18503d on hv-cinder-85236 Aug 08 18:13:55.795636 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-42029caf-292c-4478-a74c-ba810d57cd7a req-10381e8f-4d84-44d1-b9c9-d7c71caf4762 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031190 Aug 08 18:13:55.797996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 356/693] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:13:55.863973 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:55.864612 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:55.870582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:55.871007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:55.871447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:55.872133 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:55.872623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:55.873048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:56.001022 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:56.008679 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fcfa4bbd-ac27-4d44-9764-dfb3c629f627 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1553 microversion: 2.1 time: 0.148580 Aug 08 18:13:56.009253 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 338/694] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:55 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:56.776089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:56.776737 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:56.784040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:56.784762 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:56.785341 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:56.785894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:56.786364 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:56.786783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:56.851671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:56.862737 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a334d56b-efa8-4456-8d1a-63d0e98f916b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1290 microversion: 2.1 time: 0.091011 Aug 08 18:13:56.863521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 357/695] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:56 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:57.030538 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:57.031087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:57.037416 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:57.037892 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:57.038321 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:57.038998 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:57.039443 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:57.039859 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:57.253121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:57.260734 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-266d2ace-0022-4175-9b14-34bb18194c57 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1553 microversion: 2.1 time: 0.234666 Aug 08 18:13:57.261314 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 339/696] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:57 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:57.816260 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-dcdcd53e-122f-47b3-89b9-ccf90f113966 req-e555a457-a58b-4fff-bf37-d8d2090afd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc0adbbe-a03d-4b75-99d2-5a8f9c36567b", "name": "network-vif-deleted", "tag": "d266e64e-9c90-4916-b8ce-ab1d6acfc3fe"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:57.829258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-dcdcd53e-122f-47b3-89b9-ccf90f113966 req-e555a457-a58b-4fff-bf37-d8d2090afd6b service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:57.829258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-dcdcd53e-122f-47b3-89b9-ccf90f113966 req-e555a457-a58b-4fff-bf37-d8d2090afd6b service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:57.829258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-dcdcd53e-122f-47b3-89b9-ccf90f113966 req-e555a457-a58b-4fff-bf37-d8d2090afd6b service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:57.840422 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-dcdcd53e-122f-47b3-89b9-ccf90f113966 req-e555a457-a58b-4fff-bf37-d8d2090afd6b service nova] Creating event network-vif-deleted:d266e64e-9c90-4916-b8ce-ab1d6acfc3fe for instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b on hv-cinder-85236 Aug 08 18:13:57.847054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-dcdcd53e-122f-47b3-89b9-ccf90f113966 req-e555a457-a58b-4fff-bf37-d8d2090afd6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034513 Aug 08 18:13:57.847601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 358/697] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:13:57.893218 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:57.893853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:57.900544 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:57.900986 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:57.901426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:57.902127 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:57.902572 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:57.902994 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:57.964875 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:57.972831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-04639b01-70c8-4d8a-a332-6661ca1b2957 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1296 microversion: 2.1 time: 0.092789 Aug 08 18:13:57.973738 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 340/698] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:57 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:58.294599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:58.294599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:58.294599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:58.294599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:58.295768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:58.295768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:58.295768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:58.295768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:58.325189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:58.325679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:58.326114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:58.326563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lazy-loading 'fault' on Instance uuid fc0adbbe-a03d-4b75-99d2-5a8f9c36567b {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:13:58.385720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4ebbf55d214dcc835e3f43876693bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1914ba55849e4a3a55a20ed50e7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:58.393360 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3f0bcaa0-6ce5-45c0-8456-c12a0a0900a4 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 200 len: 1347 microversion: 2.1 time: 0.114954 Aug 08 18:13:58.393935 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 359/699] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:58 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 1347 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:58.994403 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:58.994944 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:58.997359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=12 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:13:59.002655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:59.003152 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:59.003589 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:59.004266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:59.004740 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:59.011040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:59.186140 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:13:59.198602 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7e64aaf0-7f3a-4343-889b-09d0d9aeafe7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1363 microversion: 2.1 time: 0.203460 Aug 08 18:13:59.198602 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 341/700] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:58 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:13:59.414405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:59.415085 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] [instance: fc0adbbe-a03d-4b75-99d2-5a8f9c36567b] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:13:59.421971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:59.422489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:59.422927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:59.425129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:59.425129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:59.425129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:59.438404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] HTTP exception thrown: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b could not be found. Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Request method failure captured: Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b HTTP/1.1 Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VGuupI8RtIwpyhJbyYe8nPOgmxdkhckzP0dbwlZ7HdArux6AdJHCPx45d0MF3ViTaTDQIiAmwAkuMNERjSnTlnqMYbgPXL3LqghQZ0EaZso5m2daG6GJKgs4zWpG3NpP07qE3jrSMSoCfOgtL6JZe1dPsnqzDhkKLRjJyXMwFxcHQ4 Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c3b1914ba55849e4a3a55a20ed50e7a1 Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-TestMinimumBasicScenario-1905856392 Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:13:59.440015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3b1914ba55849e4a3a55a20ed50e7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3b1914ba55849e4a3a55a20ed50e7a1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3b1914ba55849e4a3a55a20ed50e7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3b1914ba55849e4a3a55a20ed50e7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-TestMinimumBasicScenario-1905856392 Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c3b1914ba55849e4a3a55a20ed50e7a1 Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1905856392 Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-TestMinimumBasicScenario-1905856392-project Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 6e4ebbf55d214dcc835e3f43876693bb Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-TestMinimumBasicScenario-1905856392-project Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b could not be found. Aug 08 18:13:59.443730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'fc0adbbe-a03d-4b75-99d2-5a8f9c36567b'} Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b could not be found. Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:13:59.444685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b could not be found. Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b could not be found. Aug 08 18:13:59.446223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:13:59.447350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Returning 404 to user: Instance fc0adbbe-a03d-4b75-99d2-5a8f9c36567b could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:13:59.447350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-29c40319-f5a4-43dd-b28f-8b460c301e55 tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b" status: 404 len: 111 microversion: 2.1 time: 0.031692 Aug 08 18:13:59.447350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 360/701] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:13:59 2022] GET /compute/v2.1/servers/fc0adbbe-a03d-4b75-99d2-5a8f9c36567b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:13:59.451818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-91bb6f47-8271-4a0e-a104-7be8ea0ff30b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] Calling method '.version_select at 0x7f21acff7c10>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:13:59.517091 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-91bb6f47-8271-4a0e-a104-7be8ea0ff30b tempest-TestMinimumBasicScenario-1905856392 tempest-TestMinimumBasicScenario-1905856392-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-537330876" status: 202 len: 0 microversion: 2.1 time: 0.069794 Aug 08 18:13:59.517683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 342/702] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Aug 8 18:13:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-537330876 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:13:59.812556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-0a3ebd18-4511-4e58-9906-c6d5fc9438a7 req-793bb1c2-268d-4fb1-9fe1-6898c4664c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c647968-93d3-4345-b600-4f295d1810ce", "tag": "afd9a122-f426-43dd-9ada-811fd32407df"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:13:59.823289 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0a3ebd18-4511-4e58-9906-c6d5fc9438a7 req-793bb1c2-268d-4fb1-9fe1-6898c4664c8b service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:13:59.823757 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0a3ebd18-4511-4e58-9906-c6d5fc9438a7 req-793bb1c2-268d-4fb1-9fe1-6898c4664c8b service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:13:59.824468 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0a3ebd18-4511-4e58-9906-c6d5fc9438a7 req-793bb1c2-268d-4fb1-9fe1-6898c4664c8b service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:13:59.851538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-0a3ebd18-4511-4e58-9906-c6d5fc9438a7 req-793bb1c2-268d-4fb1-9fe1-6898c4664c8b service nova] Creating event network-changed:afd9a122-f426-43dd-9ada-811fd32407df for instance 6c647968-93d3-4345-b600-4f295d1810ce on hv-cinder-85236 Aug 08 18:13:59.857082 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-0a3ebd18-4511-4e58-9906-c6d5fc9438a7 req-793bb1c2-268d-4fb1-9fe1-6898c4664c8b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050166 Aug 08 18:13:59.857886 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 361/703] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:00.215383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:00.216004 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:00.222876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:00.223368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:00.223809 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:00.228148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:00.228148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:00.228148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:00.457459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:00.464830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-82d841d6-752a-427e-81f6-6ea7bae0bdf4 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1363 microversion: 2.1 time: 0.253465 Aug 08 18:14:00.465467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 343/704] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:00 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:00.731559 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b7eb597-6924-4d66-94f5-d12857df6bb2"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:00.733929 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:00.740018 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:00.740494 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:00.740965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:00.741686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:00.742117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:00.742538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:00.827435 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Invalid volume: volume 7b7eb597-6924-4d66-94f5-d12857df6bb2 is already attached to instances: f14da550-cc04-4944-ab43-06c1599eb76d Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: POST /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments HTTP/1.1 Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 74 Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:14:00.829405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {"volumeAttachment": {"volumeId": "7b7eb597-6924-4d66-94f5-d12857df6bb2"}} Aug 08 18:14:00.831075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Invalid volume: volume 7b7eb597-6924-4d66-94f5-d12857df6bb2 is already attached to instances: f14da550-cc04-4944-ab43-06c1599eb76d Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'server_id': 'f14da550-cc04-4944-ab43-06c1599eb76d', 'body': {'volumeAttachment': {'volumeId': '7b7eb597-6924-4d66-94f5-d12857df6bb2'}}} Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7b7eb597-6924-4d66-94f5-d12857df6bb2 is already attached to instances: f14da550-cc04-4944-ab43-06c1599eb76d Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:00.831876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7b7eb597-6924-4d66-94f5-d12857df6bb2 is already attached to instances: f14da550-cc04-4944-ab43-06c1599eb76d Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:00.833057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:00.834269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:00.834269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:14:00.834269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:14:00.834269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7b7eb597-6924-4d66-94f5-d12857df6bb2 is already attached to instances: f14da550-cc04-4944-ab43-06c1599eb76d Aug 08 18:14:00.834269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:00.834269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 400 to user: Invalid volume: volume 7b7eb597-6924-4d66-94f5-d12857df6bb2 is already attached to instances: f14da550-cc04-4944-ab43-06c1599eb76d {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:14:00.834269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0e4d52ee-64b8-40d0-a2e2-1031bf2852fc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104336 Aug 08 18:14:00.834269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 362/705] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:14:00 2022] POST /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 18:14:00.896259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:00.896865 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:00.898834 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:00.903529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:00.904094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:00.904676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:00.905473 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:00.906048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:00.906484 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:00.990515 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lazy-loading 'services' on Instance uuid f14da550-cc04-4944-ab43-06c1599eb76d {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:14:01.194904 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8150f1ae-fad8-47d0-aec5-e528497ba832 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments/7b7eb597-6924-4d66-94f5-d12857df6bb2" status: 202 len: 0 microversion: 2.1 time: 0.303645 Aug 08 18:14:01.195733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 344/706] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:14:00 2022] DELETE /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments/7b7eb597-6924-4d66-94f5-d12857df6bb2 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:14:01.204827 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:01.206983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:01.212800 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:01.213282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:01.213714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:01.214396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:01.214847 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:01.215265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:01.245476 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2957d672-79cd-485e-bca2-ab72df5d057d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Aug 08 18:14:01.245945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 363/707] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:14:01 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:01.485701 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:01.486390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:01.493127 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:01.493608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:01.494041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:01.494740 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:01.495190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:01.495660 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:01.627960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:01.635442 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d5a6fa77-1432-4d08-a732-8e9467da8a31 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1363 microversion: 2.1 time: 0.153943 Aug 08 18:14:01.636008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 345/708] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:01 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:02.258105 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:02.260547 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:02.263318 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:02.269294 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:02.270115 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:02.270813 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:02.271753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:02.272278 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:02.272787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:02.310266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b985aaf0-2137-416f-83fd-d62a658db88b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056273 Aug 08 18:14:02.311446 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 364/709] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:14:02 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:02.656122 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:02.656865 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:02.665084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:02.665662 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:02.666261 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:02.667040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:02.667504 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:02.667934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:02.821107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:02.832159 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4031ea48-66ea-4063-b935-5a5074feeb28 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1363 microversion: 2.1 time: 0.180659 Aug 08 18:14:02.836768 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 346/710] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:02 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:03.323015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:03.325178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:03.327026 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=8 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:03.332560 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:03.333045 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:03.333479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:03.334179 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:03.334634 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:03.335054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:03.364290 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e2ad8309-ab5c-498e-baf9-ca12d9b46756 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045271 Aug 08 18:14:03.364883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 365/711] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:14:03 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:14:03.430688 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:03.431238 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:03.445615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:03.445615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:03.445615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:03.445615 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:03.446077 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:03.446077 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:03.469195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:14:03.855392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:03.856120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:03.863184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:03.864201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:03.864873 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:03.866086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:03.866846 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:03.869623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:03.874273 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-390327f6-cc4b-4ca1-9909-d37e683feb06 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 204 len: 0 microversion: 2.1 time: 0.447114 Aug 08 18:14:03.878715 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 347/712] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:14:03 2022] DELETE /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:14:03.886326 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:03.887043 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:03.894630 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:03.895806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:03.896542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:03.897926 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:03.898529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:03.898968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:04.067637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:04.077872 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d1dd99a3-5cfe-4019-8d34-5ddecc72571d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1363 microversion: 2.1 time: 0.226695 Aug 08 18:14:04.083203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 366/713] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:03 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:04.118393 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:04.128113 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4705d8c4-fd7a-4ce2-8470-e49369f990a5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1679 microversion: 2.1 time: 0.246963 Aug 08 18:14:04.128815 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 348/714] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:03 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:05.101190 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:05.101903 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:05.109967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:05.110440 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:05.110883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:05.111740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:05.112378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:05.112841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:05.151240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:05.151758 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:05.158550 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:05.159040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:05.159482 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:05.160187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:05.160678 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:05.161110 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:05.181235 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:05.419682 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:05.427722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ef7921e9-cb6e-426d-8d1d-83ade2457e26 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1363 microversion: 2.1 time: 0.330679 Aug 08 18:14:05.428291 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 367/715] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:05 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:05.432782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:05.433519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:05.440370 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:05.440956 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:05.441387 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:05.442084 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:05.442533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:05.442946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:05.456753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:05.464047 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1c1c61e3-ca39-477e-9110-7ae201b1c67f tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1679 microversion: 2.1 time: 0.316635 Aug 08 18:14:05.468859 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 349/716] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:05 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1679 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:05.493024 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lazy-loading 'flavor' on Instance uuid bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:14:05.777076 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-91117f22-d8f0-4aa4-8297-44c1b938dbe9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "POST /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.347516 Aug 08 18:14:05.777903 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 368/717] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:14:05 2022] POST /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:14:05.786584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:05.805688 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:05.813184 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:05.813818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:05.814471 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:05.815804 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:05.816894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:05.817532 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:06.009698 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:06.018209 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-881774e3-9a67-4be7-8da7-2d1bc2d57cc9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.236031 Aug 08 18:14:06.019439 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 350/718] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:05 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:06.032244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-e63cd226-86eb-4cd0-aaff-99a54b120a7b req-55a66e37-f18b-4243-8249-008c41f21b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c647968-93d3-4345-b600-4f295d1810ce", "name": "network-vif-plugged", "status": "completed", "tag": "afd9a122-f426-43dd-9ada-811fd32407df"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:06.040093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e63cd226-86eb-4cd0-aaff-99a54b120a7b req-55a66e37-f18b-4243-8249-008c41f21b53 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:06.040834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e63cd226-86eb-4cd0-aaff-99a54b120a7b req-55a66e37-f18b-4243-8249-008c41f21b53 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:06.041060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-e63cd226-86eb-4cd0-aaff-99a54b120a7b req-55a66e37-f18b-4243-8249-008c41f21b53 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:06.053728 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-e63cd226-86eb-4cd0-aaff-99a54b120a7b req-55a66e37-f18b-4243-8249-008c41f21b53 service nova] Creating event network-vif-plugged:afd9a122-f426-43dd-9ada-811fd32407df for instance 6c647968-93d3-4345-b600-4f295d1810ce on hv-cinder-85236 Aug 08 18:14:06.058452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-e63cd226-86eb-4cd0-aaff-99a54b120a7b req-55a66e37-f18b-4243-8249-008c41f21b53 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Aug 08 18:14:06.059243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 369/719] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:14:06.490265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:06.491692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:06.498717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:06.499207 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:06.499643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:06.500334 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:06.500814 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:06.501278 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:06.522769 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:06.524082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:06.532712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:06.533467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:06.534160 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:06.535755 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:06.536484 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:06.537144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:07.242657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:07.251252 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-01aa95ff-56d8-4de7-b172-1fab18bb0fed tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1679 microversion: 2.1 time: 0.765581 Aug 08 18:14:07.251822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 370/720] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:06 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1679 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:07.264734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:07.265022 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:07.265140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:07.265140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:07.265140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:07.265140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:07.265471 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:07.265560 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:07.265948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:07.267806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5944250b-315e-4312-ac81-c92d85c9669d tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1363 microversion: 2.1 time: 0.821276 Aug 08 18:14:07.268535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 351/721] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:06 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1363 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:07.269620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:07.598251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:07.605775 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-44f197a0-0d08-47ea-8b4c-f9fd7ef5217f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.352995 Aug 08 18:14:07.606342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 371/722] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:07 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:08.214420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-c273a9c8-138f-4a5f-be7a-f25c397cdab2 req-b0699229-40f6-4bb8-9018-e8970e05c65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f14da550-cc04-4944-ab43-06c1599eb76d", "name": "network-vif-deleted", "tag": "ef012167-4a38-44b0-b9ca-33901ecd9187"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:08.225647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c273a9c8-138f-4a5f-be7a-f25c397cdab2 req-b0699229-40f6-4bb8-9018-e8970e05c65c service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:08.226306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c273a9c8-138f-4a5f-be7a-f25c397cdab2 req-b0699229-40f6-4bb8-9018-e8970e05c65c service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:08.226958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c273a9c8-138f-4a5f-be7a-f25c397cdab2 req-b0699229-40f6-4bb8-9018-e8970e05c65c service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:08.240041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-c273a9c8-138f-4a5f-be7a-f25c397cdab2 req-b0699229-40f6-4bb8-9018-e8970e05c65c service nova] Creating event network-vif-deleted:ef012167-4a38-44b0-b9ca-33901ecd9187 for instance f14da550-cc04-4944-ab43-06c1599eb76d on hv-cinder-85236 Aug 08 18:14:08.246510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-c273a9c8-138f-4a5f-be7a-f25c397cdab2 req-b0699229-40f6-4bb8-9018-e8970e05c65c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035910 Aug 08 18:14:08.252646 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 352/723] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:08.280907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:08.281551 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:08.295231 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:08.296574 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:08.322008 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:08.324643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:08.325073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:08.325760 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:08.326995 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:08.328907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:08.329232 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:08.329897 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:08.331476 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:08.331886 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:08.335852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:08.336663 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:08.489968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:08.503345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6f77c7fb-3055-4b2b-be05-87509f046d6b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1612 microversion: 2.1 time: 0.231066 Aug 08 18:14:08.507541 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 372/724] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:08 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1612 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:08.574382 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:08.585100 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-aa13e3c9-3d6c-4f67-83c0-6a504e972c8b tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1363 microversion: 2.1 time: 0.298468 Aug 08 18:14:08.586045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 353/725] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:08 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:08.627206 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:08.627960 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:08.634699 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:08.635200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:08.635645 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:08.636347 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:08.636976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:08.637555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:08.777362 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:08.786354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b4c3778f-a37d-4cdd-90dc-0f2d0ed58d3d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.163081 Aug 08 18:14:08.787230 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 373/726] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:08 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:09.527760 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:09.528376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:09.535872 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.536353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.536988 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:09.538750 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.539445 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.540028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:09.590692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.591228 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.591668 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:09.592799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lazy-loading 'fault' on Instance uuid f14da550-cc04-4944-ab43-06c1599eb76d {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:14:09.606527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:09.611955 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:09.623530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.624026 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.624465 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:09.628187 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.628187 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.628187 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:09.642831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:09.668849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9bd0dcd2-9f21-4d3f-8371-ffb88bae4abc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 200 len: 1331 microversion: 2.1 time: 0.129869 Aug 08 18:14:09.668849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 354/727] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:09 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:09.809397 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:09.810007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:09.820896 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.824724 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.825334 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:09.827847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.828283 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.828768 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:09.845119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:09.854729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-54279109-2ed3-48df-b89f-046bc1b99ee7 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1550 microversion: 2.1 time: 0.250110 Aug 08 18:14:09.858683 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 374/728] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:09 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1550 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:09.883691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:09.884192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:09.893572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.894068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.895175 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:09.898788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:09.899278 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:09.900195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:10.017132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1a59d92f-ab01-475d-8df2-b322ff7a76a8 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139028 Aug 08 18:14:10.017758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 375/729] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 18:14:09 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:14:10.062093 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:10.069883 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1bd8ae45-a1b6-4b40-b001-f79084dd42f0 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.265357 Aug 08 18:14:10.070377 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 355/730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:09 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:10.675985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:10.676612 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:10.682589 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:10.683065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:10.683492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:10.684236 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:10.684711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:10.685127 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:10.699470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d HTTP/1.1 Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:14:10.701167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:14:10.702952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'f14da550-cc04-4944-ab43-06c1599eb76d'} Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:14:10.703792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:14:10.705021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:10.706096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:14:10.706096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9708f925-c178-4d45-bb58-8dda7c796f85 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 404 len: 111 microversion: 2.1 time: 0.031229 Aug 08 18:14:10.706096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 376/731] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:10 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:14:10.711570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-441c50fa-8c6c-4150-bf50-156477b21471 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '.version_select at 0x7f21acdf9430>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:10.791588 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-441c50fa-8c6c-4150-bf50-156477b21471 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818077734" status: 202 len: 0 microversion: 2.1 time: 0.083598 Aug 08 18:14:10.792866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 356/732] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 18:14:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818077734 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:14:11.080696 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-7f1ccc1f-52b4-43ff-a813-8bc57a265a42 req-486cf08d-d7bb-4fd8-97ce-115329930090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c647968-93d3-4345-b600-4f295d1810ce", "tag": "afd9a122-f426-43dd-9ada-811fd32407df"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:11.082932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-7f1ccc1f-52b4-43ff-a813-8bc57a265a42 req-486cf08d-d7bb-4fd8-97ce-115329930090 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:11.083415 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-7f1ccc1f-52b4-43ff-a813-8bc57a265a42 req-486cf08d-d7bb-4fd8-97ce-115329930090 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:11.083841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-7f1ccc1f-52b4-43ff-a813-8bc57a265a42 req-486cf08d-d7bb-4fd8-97ce-115329930090 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:11.091383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:11.092494 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:11.099737 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-7f1ccc1f-52b4-43ff-a813-8bc57a265a42 req-486cf08d-d7bb-4fd8-97ce-115329930090 service nova] Creating event network-changed:afd9a122-f426-43dd-9ada-811fd32407df for instance 6c647968-93d3-4345-b600-4f295d1810ce on hv-cinder-85236 Aug 08 18:14:11.105262 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-7f1ccc1f-52b4-43ff-a813-8bc57a265a42 req-486cf08d-d7bb-4fd8-97ce-115329930090 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036561 Aug 08 18:14:11.109091 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:11.109557 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:11.109998 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:11.110208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 377/733] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:11.110719 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:11.111214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:11.121212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:11.732959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:11.741834 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-04064089-9759-4860-b0af-070f81bcd1c8 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.653975 Aug 08 18:14:11.760624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 357/734] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:11 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:12.407781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fbd9b911-67dd-4b28-ad21-29a43d9ced11 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: .version_select at 0x7f21ac555790>, body: {"keypair": {"name": "tempest-keypair-279857732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt1feDtTegAKlDHecc4vS7iSHF7vHbMwH3geE5Y4zQvcxWon3jB6mO11X0Rx1o5kH4zzfL6oayfpXZaAxP8ghiBtR4aMh8Js3xKDU/YDdot6qa0V/fbmzK4C5sB6vbozA=="}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:12.423608 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-fbd9b911-67dd-4b28-ad21-29a43d9ced11 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:14:12.427480 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-fbd9b911-67dd-4b28-ad21-29a43d9ced11 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for user 2d5e7d5c77084705b1f39406293ab585 and project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:14:12.517411 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fbd9b911-67dd-4b28-ad21-29a43d9ced11 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115110 Aug 08 18:14:12.518002 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 378/735] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:14:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:12.763409 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:12.764612 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:12.772296 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:12.772800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:12.773407 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:12.774161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:12.774534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:12.774951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:12.906789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:12.914608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e49b204e-ace0-411c-9c83-5a5d778b5be9 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.154905 Aug 08 18:14:12.915180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 358/736] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:12 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:13.936108 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:13.937368 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:13.944057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:13.948727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:13.948727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:13.948727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:13.948727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:13.949163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:14.076424 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:14.084829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0f0e8322-2d15-4763-a768-9217db613333 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.153187 Aug 08 18:14:14.086213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 379/737] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:13 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:14.788078 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-771222711", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47bba831-90ff-4040-8010-199ec976c9aa"}], "security_groups": [{"name": "tempest-securitygroup--966897198"}], "key_name": "tempest-keypair-279857732", "user_data": "}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:14.894660 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] validate_networks() for [('47bba831-90ff-4040-8010-199ec976c9aa', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:14:15.106465 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:15.107395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:15.114188 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:15.114672 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:15.115107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:15.115834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:15.116287 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:15.116748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:15.320580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:15.328935 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-448e7a8a-5b20-4817-ae4c-5ea0c7c38717 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.227129 Aug 08 18:14:15.329514 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 380/738] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:15 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:15.406097 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:14:15.406507 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:14:15.411607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:14:15.411607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:14:15.411607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:14:15.416474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:15.416981 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:15.417409 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:15.418251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:15.418700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:15.419117 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:15.435176 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:14:15.439566 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Getting quotas for user 2d5e7d5c77084705b1f39406293ab585 and project c0061f213bfd4e3b87a0582b6cec6487. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:14:15.450222 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:14:15.453301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:14:15.568084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e5ede091-786b-4b2a-8547-0aea33af159d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.784193 Aug 08 18:14:15.568858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 359/739] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:14:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:14:15.579783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-76bea0b6-e970-45a1-b456-4a7136718794 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:15.580399 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-76bea0b6-e970-45a1-b456-4a7136718794 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:15.637519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-76bea0b6-e970-45a1-b456-4a7136718794 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:15.644152 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-76bea0b6-e970-45a1-b456-4a7136718794 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1240 microversion: 2.1 time: 0.068421 Aug 08 18:14:15.644764 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 381/740] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:15 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:16.351685 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:16.352304 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:16.359015 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:16.359503 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:16.359946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:16.360680 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:16.361142 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:16.361717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:16.504642 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:16.512448 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c6f3a313-087d-4c0a-8437-024fde612ead tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.165142 Aug 08 18:14:16.513130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 360/741] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:16 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:16.665110 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:16.665850 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:16.672470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:16.673058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:16.673507 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:16.674194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:16.674651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:16.675099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:16.749097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:16.756469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0eee3fa1-1b64-413f-9d9a-c357b37a4066 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1244 microversion: 2.1 time: 0.095225 Aug 08 18:14:16.757072 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 382/742] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:16 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:17.533531 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:17.534069 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:17.540633 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:17.541125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:17.541562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:17.542256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:17.542716 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:17.543145 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:17.674746 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:17.682145 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-764fa8c5-17ff-4246-8517-4a3127a18126 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.152653 Aug 08 18:14:17.682708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 361/743] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:17 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:17.777790 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:17.778407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:17.781344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:17.786178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:17.786607 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:17.787049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:17.787750 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:17.788202 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:17.788659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:17.850147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:17.857788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-045848cd-86f8-4a71-8f15-fe2f27c8653c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1292 microversion: 2.1 time: 0.083853 Aug 08 18:14:17.859215 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 383/744] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:17 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:18.705929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:18.706552 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:18.712977 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:18.713467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:18.713908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:18.714598 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:18.715054 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:18.715480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:18.843922 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:18.851584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f76bdad4-df7f-438e-bce8-e987ed2d8e44 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.150396 Aug 08 18:14:18.852183 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 362/745] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:18 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:18.879775 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:18.880383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:18.887125 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:18.887623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:18.888069 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:18.888787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:18.889241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:18.889662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:18.952481 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:18.960649 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6ce4f7d6-9146-4c2a-a305-9cb0c769ca8b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1292 microversion: 2.1 time: 0.084727 Aug 08 18:14:18.961516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 384/746] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:18 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:19.873210 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:19.873768 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:19.880652 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:19.881432 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:19.881876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:19.882653 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:19.883109 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:19.883533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:19.981607 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:19.982222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:19.988818 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:19.989400 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:19.989872 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:19.996830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:19.996830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:19.996830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:20.162576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:20.170220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-381cb1fb-6355-4a4c-a94b-b86f156daafd tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1569 microversion: 2.1 time: 0.300943 Aug 08 18:14:20.184529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 363/747] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:19 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1569 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:20.191386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:20.192215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:20.198558 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:20.204542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:20.204542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:20.204542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:20.204542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:20.204915 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:20.248436 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118381) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 18:14:20.260181 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:20.268614 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3bce2494-f2b2-4537-a197-e0e437cf3738 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.291108 Aug 08 18:14:20.271680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 385/748] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:19 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:20.587243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6ccb1959-affc-4308-9a1e-e86cee221836 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "POST /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.399704 Aug 08 18:14:20.587849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 364/749] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Aug 8 18:14:20 2022] POST /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:14:20.596174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:20.596818 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:20.603247 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:20.603925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:20.605100 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:20.605809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:20.606267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:20.606691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:20.805761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:20.813011 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-05906e36-3e69-4fef-88ac-528998d9b7d2 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1517 microversion: 2.1 time: 0.220774 Aug 08 18:14:20.813596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 386/750] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:20 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:20.880623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-dd3211ec-c738-4f00-b107-4b0b1e1d7ca6 req-02360cc0-7f42-4b4c-8645-7ced3068b1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed37849-c0e9-4d24-a56d-ecdd9bce3532", "tag": "836263e2-1319-4c1c-9ff3-124e27aadbde"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:20.898684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-dd3211ec-c738-4f00-b107-4b0b1e1d7ca6 req-02360cc0-7f42-4b4c-8645-7ced3068b1e7 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:20.899507 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-dd3211ec-c738-4f00-b107-4b0b1e1d7ca6 req-02360cc0-7f42-4b4c-8645-7ced3068b1e7 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:20.900174 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-dd3211ec-c738-4f00-b107-4b0b1e1d7ca6 req-02360cc0-7f42-4b4c-8645-7ced3068b1e7 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:20.912583 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-dd3211ec-c738-4f00-b107-4b0b1e1d7ca6 req-02360cc0-7f42-4b4c-8645-7ced3068b1e7 service nova] Creating event network-changed:836263e2-1319-4c1c-9ff3-124e27aadbde for instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 on hv-cinder-85236 Aug 08 18:14:20.917904 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-dd3211ec-c738-4f00-b107-4b0b1e1d7ca6 req-02360cc0-7f42-4b4c-8645-7ced3068b1e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040718 Aug 08 18:14:20.918628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 365/751] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:21.289771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:21.290381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:21.296597 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:21.297118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:21.297558 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:21.298250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:21.298701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:21.299307 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:21.501441 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:21.509814 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6bee257f-548d-4282-97c7-f8f5df0a660c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.224034 Aug 08 18:14:21.510381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 387/752] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:21 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:21.795496 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:21.800309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:21.802955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:21.803712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:21.803866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:21.804678 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:21.805216 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:21.805643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:21.834654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:21.835263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:21.841803 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:21.842298 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:21.842770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:21.843541 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:21.843893 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:21.844319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:21.895564 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lazy-loading 'services' on Instance uuid ca3a285c-f9d9-4be0-b67e-94e7a7eee516 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:14:21.984435 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:21.992034 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d58aff05-fab1-4705-b47e-a99e74c8c847 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1519 microversion: 2.1 time: 0.161228 Aug 08 18:14:21.992616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 388/753] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:21 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:22.040280 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-999aff8a-d8e8-4851-a268-adc3f5e68646 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments/38d05c4a-8b63-4dd7-8541-aea77d415513" status: 202 len: 0 microversion: 2.1 time: 0.249128 Aug 08 18:14:22.040832 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 366/754] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:14:21 2022] DELETE /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments/38d05c4a-8b63-4dd7-8541-aea77d415513 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:14:22.049671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:22.051832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:22.057902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:22.058387 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:22.058829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:22.059509 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:22.059968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:22.060392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:22.090223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-687920c3-9e32-4b59-986f-fc4a8e257257 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044860 Aug 08 18:14:22.090779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 389/755] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:14:22 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:22.531930 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:22.532663 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:22.538805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:22.539293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:22.539732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:22.540428 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:22.540911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:22.541337 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:22.545449 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:22.677145 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:22.684474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e964abc2-e526-44d5-aa9a-34c6699d6788 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.157489 Aug 08 18:14:22.685057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 367/756] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:22 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:23.013417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:23.014159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:23.021176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:23.021665 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:23.022106 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:23.022790 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:23.023250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:23.023678 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:23.102989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:23.105276 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:23.111460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:23.111952 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:23.112391 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:23.113244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:23.113703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:23.114131 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:23.144386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-142d62c4-d05b-4b75-92ac-e0f442635ee3 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Aug 08 18:14:23.144984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 368/757] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:14:23 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:14:23.154160 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:23.161897 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-09c3b4f4-98f4-4e8b-b613-0494d7c04550 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1519 microversion: 2.1 time: 0.152295 Aug 08 18:14:23.162452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 390/758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:23 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:23.705915 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:23.706548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:23.713266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:23.713748 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:23.714182 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:23.714900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:23.715406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:23.715730 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:23.858946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:23.866418 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bd10b803-9dd2-4095-b499-792c982b2872 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.165363 Aug 08 18:14:23.867029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 369/759] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:23 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:23.990371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-d299bc43-455e-4569-af58-24e185df6a6f req-6b797683-ccbc-4f43-9610-641a6d8cd817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d", "name": "network-vif-unplugged", "status": "completed", "tag": "ba2a15cb-dff8-4775-9544-c1155b4411cf"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:24.000029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d299bc43-455e-4569-af58-24e185df6a6f req-6b797683-ccbc-4f43-9610-641a6d8cd817 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:24.000594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d299bc43-455e-4569-af58-24e185df6a6f req-6b797683-ccbc-4f43-9610-641a6d8cd817 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:24.000966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d299bc43-455e-4569-af58-24e185df6a6f req-6b797683-ccbc-4f43-9610-641a6d8cd817 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:24.011513 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.compute.server_external_events [req-d299bc43-455e-4569-af58-24e185df6a6f req-6b797683-ccbc-4f43-9610-641a6d8cd817 service nova] Unable to find a host for instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d. Dropping event network-vif-unplugged {{(pid=118382) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 18:14:24.012380 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-d299bc43-455e-4569-af58-24e185df6a6f req-6b797683-ccbc-4f43-9610-641a6d8cd817 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025885 Aug 08 18:14:24.012987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 391/760] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 08 18:14:24.156736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:24.158942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:24.164837 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:24.165323 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:24.165763 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:24.166465 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:24.167023 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:24.167452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:24.182702 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:24.183307 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:24.190628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:24.191104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:24.191528 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:24.192205 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:24.192679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:24.193094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:24.197006 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:24.197780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3271493f-0853-4f65-b386-cd5ad2fb7f66 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Aug 08 18:14:24.202243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 370/761] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:14:24 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:24.323200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:24.332294 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-97096b31-4641-4575-80f9-3b0843ab0389 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1519 microversion: 2.1 time: 0.153303 Aug 08 18:14:24.332993 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 392/762] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:24 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:24.887132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:24.887739 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:24.894137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:24.894616 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:24.895049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:24.895736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:24.896188 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:24.896635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.087764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:25.087764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5b5a5e82-f94c-40fd-9ff4-22a3a285456d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.187992 Aug 08 18:14:25.087764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 371/763] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:24 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:25.210285 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:25.212429 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:25.219444 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:25.219819 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:25.219929 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.220621 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:25.221083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:25.221505 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.250773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-eb8adabb-d263-4dab-b2f5-ba5377fb68f6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044390 Aug 08 18:14:25.251537 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 393/764] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:14:25 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:14:25.331694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:25.332264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:25.338289 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:25.338980 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:25.339417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.340104 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:25.340576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:25.340999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.354670 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:25.355398 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:25.362618 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:25.363414 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:25.364021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.364913 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:25.365526 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:25.366121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.368094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:14:25.426789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:25.446256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:25.586248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:25.600656 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-423f17d1-e412-491c-b09d-3fb5bded97fe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.250026 Aug 08 18:14:25.602238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 394/765] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:25 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:25.710182 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ca64f559-bb28-48f8-8f36-6a83d2b24881 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 204 len: 0 microversion: 2.1 time: 0.382345 Aug 08 18:14:25.710792 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 372/766] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:14:25 2022] DELETE /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:14:25.727705 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:25.728320 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:25.730165 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=6 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:25.734988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:25.735479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:25.735916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.736644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:25.737102 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:25.737533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:25.870660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:25.875307 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-778d7395-4101-4686-b9ab-c90c5833ff00 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1689 microversion: 2.1 time: 0.151517 Aug 08 18:14:25.875902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 395/767] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:25 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:26.107062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:26.107760 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:26.114798 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:26.115414 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:26.115848 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:26.116550 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:26.117005 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:26.117423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:26.249898 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:26.257376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b24c7669-1ac9-4c88-8357-f6abaac80cd0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.154908 Aug 08 18:14:26.257954 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 373/768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:26 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:26.626972 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:26.627579 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:26.634130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:26.634610 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:26.635043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:26.635727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:26.636178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:26.636624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:26.767778 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:26.775259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b6589825-cdcd-49fa-9d49-3fda90747610 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.152274 Aug 08 18:14:26.775830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 396/769] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:26 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:26.896650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:26.897270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:26.903317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:26.903808 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:26.904248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:26.904983 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:26.905444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:26.905872 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:27.033909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:27.041676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1c8910d7-d8a2-4483-8d4e-ae63db38623e tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1689 microversion: 2.1 time: 0.148896 Aug 08 18:14:27.042245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 374/770] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:26 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:27.277965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:27.278574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:27.284541 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:27.284983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:27.285419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:27.286109 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:27.286564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:27.287031 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:27.412306 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:27.419691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-60244b54-1998-4966-96c7-64686d41ec99 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.145701 Aug 08 18:14:27.420254 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 397/771] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:27 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:27.796859 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:27.797480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:27.800994 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:27.804355 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:27.804906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:27.805346 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:27.806072 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:27.806534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:27.806964 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:27.936218 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:27.944405 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c1fc25a4-8ce1-4043-a8e5-a60dc95bdf4f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.151894 Aug 08 18:14:27.945001 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 375/772] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:27 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:28.062970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:28.063571 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:28.069758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:28.070238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:28.070674 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:28.071363 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:28.071822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:28.072245 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:28.163571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-2b4f41b5-bd28-4c32-bf12-32f0ce601230 req-af53726a-a6c4-47de-b21c-adea5448de08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed37849-c0e9-4d24-a56d-ecdd9bce3532", "name": "network-vif-plugged", "status": "completed", "tag": "836263e2-1319-4c1c-9ff3-124e27aadbde"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:28.174962 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-2b4f41b5-bd28-4c32-bf12-32f0ce601230 req-af53726a-a6c4-47de-b21c-adea5448de08 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:28.175747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-2b4f41b5-bd28-4c32-bf12-32f0ce601230 req-af53726a-a6c4-47de-b21c-adea5448de08 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:28.176160 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-2b4f41b5-bd28-4c32-bf12-32f0ce601230 req-af53726a-a6c4-47de-b21c-adea5448de08 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:28.187335 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-2b4f41b5-bd28-4c32-bf12-32f0ce601230 req-af53726a-a6c4-47de-b21c-adea5448de08 service nova] Creating event network-vif-plugged:836263e2-1319-4c1c-9ff3-124e27aadbde for instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 on hv-cinder-85236 Aug 08 18:14:28.193300 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-2b4f41b5-bd28-4c32-bf12-32f0ce601230 req-af53726a-a6c4-47de-b21c-adea5448de08 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Aug 08 18:14:28.194094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 376/773] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:14:28.206075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:28.213684 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-eaced29b-a4ed-4e29-a763-1d9c4b62e33f tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1689 microversion: 2.1 time: 0.155301 Aug 08 18:14:28.214300 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 398/774] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:28 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:28.441647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:28.442382 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:28.448584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:28.449018 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:28.449454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:28.450149 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:28.450611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:28.451038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:28.579198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:28.586991 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ad21080d-b6ff-4b5f-8f17-0f8e4a4b5bba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.149472 Aug 08 18:14:28.587559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 377/775] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:28 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:28.965838 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:28.966371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:28.972390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:28.972900 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:28.973334 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:28.974017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:28.974467 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:28.974886 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:29.234992 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:29.235548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:29.242329 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:29.245269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:29.245269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:29.245269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:29.245269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:29.245753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:29.391754 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:29.399483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-32ca4868-2267-49a5-b41c-fe9d6cc40f92 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.437575 Aug 08 18:14:29.400152 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 399/776] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:28 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:29.435134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:29.443797 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c249e9d6-262a-4ed4-a76f-bebfddc6ec5b tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1689 microversion: 2.1 time: 0.212825 Aug 08 18:14:29.444376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 378/777] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:29 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:29.607219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:29.607828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:29.614411 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:29.614905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:29.615345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:29.616067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:29.616538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:29.616968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:29.747819 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:29.755460 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-61a69445-0a43-46b5-bc16-8a0c9b133890 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.152043 Aug 08 18:14:29.756192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 400/778] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:29 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:30.420088 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:30.420680 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:30.427267 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:30.427754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:30.428193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:30.428938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:30.429362 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:30.429780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:30.467134 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:30.467764 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:30.478904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:30.478904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:30.478904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:30.478904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:30.479295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:30.479295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:30.575505 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:30.583882 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-94abb73e-7639-4d42-91ff-d0e8129d08a4 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1622 microversion: 2.1 time: 0.122700 Aug 08 18:14:30.597404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 401/779] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:30 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1622 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:30.672977 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:30.680679 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f6bcfc29-8aa6-4fc5-85c5-37b988fb7615 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.264618 Aug 08 18:14:30.681261 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 379/780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:30 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:30.775396 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:30.776050 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:30.782194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:30.782678 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:30.783293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:30.784018 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:30.784466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:30.784904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:30.945717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-1ccdb3b1-4e4b-4d67-8514-5e9d000d148a req-94dc099b-cc7b-47bc-b41f-66538b3bb3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3a285c-f9d9-4be0-b67e-94e7a7eee516", "name": "network-vif-deleted", "tag": "304be941-82c9-4c43-a117-34baa084b8dd"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:30.950110 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:30.957367 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-1ccdb3b1-4e4b-4d67-8514-5e9d000d148a req-94dc099b-cc7b-47bc-b41f-66538b3bb3bf service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:30.958038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6225bc67-cab4-4d03-8d56-6c9853223d3c tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1365 microversion: 2.1 time: 0.186604 Aug 08 18:14:30.958214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-1ccdb3b1-4e4b-4d67-8514-5e9d000d148a req-94dc099b-cc7b-47bc-b41f-66538b3bb3bf service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:30.958857 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-1ccdb3b1-4e4b-4d67-8514-5e9d000d148a req-94dc099b-cc7b-47bc-b41f-66538b3bb3bf service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:30.959878 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 402/781] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:30 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:30.975869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-1ccdb3b1-4e4b-4d67-8514-5e9d000d148a req-94dc099b-cc7b-47bc-b41f-66538b3bb3bf service nova] Creating event network-vif-deleted:304be941-82c9-4c43-a117-34baa084b8dd for instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 on hv-cinder-85236 Aug 08 18:14:30.981428 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-1ccdb3b1-4e4b-4d67-8514-5e9d000d148a req-94dc099b-cc7b-47bc-b41f-66538b3bb3bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113617 Aug 08 18:14:30.982385 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 380/782] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:31.605228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:31.605887 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:31.612979 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:31.613493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:31.613902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:31.614642 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:31.615094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:31.615513 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:31.648848 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:31.649339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:31.649777 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:31.650228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lazy-loading 'fault' on Instance uuid ca3a285c-f9d9-4be0-b67e-94e7a7eee516 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:14:31.692292 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:31.699940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d299681f-37d5-4a65-8660-c38cc952926c tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 200 len: 1336 microversion: 2.1 time: 0.098605 Aug 08 18:14:31.700673 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 403/783] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:31 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:31.703629 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:31.705019 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:31.711573 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:31.712315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:31.712850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:31.713891 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:31.714350 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:31.714782 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:31.856899 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:31.865165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bc36d64f-4420-4b58-80f5-7337acb51ed3 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.167143 Aug 08 18:14:31.865718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 381/784] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:31 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:31.979698 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:31.980329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:31.986463 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:31.986951 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:31.987388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:31.988093 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:31.988580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:31.989007 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:32.118722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:32.127002 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4099e900-66c7-4c47-b9a6-ed094b033ef1 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1555 microversion: 2.1 time: 0.151185 Aug 08 18:14:32.127566 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 404/785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:31 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:32.147452 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:32.147997 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:32.153963 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:32.154447 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:32.154886 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:32.155578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:32.156032 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:32.156460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:32.232130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-08b06d92-bd5a-484a-8735-1394e96f9770 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088526 Aug 08 18:14:32.232793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 382/786] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Aug 8 18:14:32 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:32.721600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:32.722213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: ca3a285c-f9d9-4be0-b67e-94e7a7eee516] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:32.728534 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:32.729047 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:32.729486 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:32.730181 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:32.730632 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:32.731058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:32.746125 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] HTTP exception thrown: Instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 could not be found. Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Request method failure captured: Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 HTTP/1.1 Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFBJBvNIm8XO1o8nN70rM82JzCWThocYUlsFdB_3inGl2Ht2Ok5s6cLQPQm16uUMwEw_YZovD4MX6nOwbs-9NOtLX3YCSTDvhVzznPguIbY9onCuhox29kZtgl8DnU-CYK2a7fiU_F3st4_DuOuelqdgPGett66k1D1zpaEJHLz88E Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:14:32.747747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_34b812a3f98747eeac35fbc27a342ab0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 4c7a6c1d08554db09d65394ec338f8b5 Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 could not be found. Aug 08 18:14:32.749457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'ca3a285c-f9d9-4be0-b67e-94e7a7eee516'} Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 could not be found. Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:14:32.750393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 could not be found. Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 could not be found. Aug 08 18:14:32.751925 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:32.757488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Returning 404 to user: Instance ca3a285c-f9d9-4be0-b67e-94e7a7eee516 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:14:32.757488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5d6179cb-1d2b-4057-acc6-cc60fc5d9663 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516" status: 404 len: 111 microversion: 2.1 time: 0.031943 Aug 08 18:14:32.757488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 405/787] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:32 2022] GET /compute/v2.1/servers/ca3a285c-f9d9-4be0-b67e-94e7a7eee516 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:14:32.758436 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a4b3bec7-5c82-4744-955f-3b343bf8665a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '.version_select at 0x7f21acdb9dc0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:32.831831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a4b3bec7-5c82-4744-955f-3b343bf8665a tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364518598" status: 202 len: 0 microversion: 2.1 time: 0.077648 Aug 08 18:14:32.832421 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 383/788] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 18:14:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364518598 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:14:32.885619 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:32.886237 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:32.892882 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:32.893374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:32.893811 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:32.894508 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:32.894962 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:32.895583 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:33.107088 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:33.116042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ab5393c0-468c-47da-ae43-c01bfb97aa57 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.234060 Aug 08 18:14:33.123724 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 406/789] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:32 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:33.313283 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-fd68c838-cbd2-44fe-ae7d-da4b87cd2ae4 req-26e0c341-6a65-4075-a1ab-0b8713fb2009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed37849-c0e9-4d24-a56d-ecdd9bce3532", "tag": "836263e2-1319-4c1c-9ff3-124e27aadbde"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:33.323457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fd68c838-cbd2-44fe-ae7d-da4b87cd2ae4 req-26e0c341-6a65-4075-a1ab-0b8713fb2009 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:33.324071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fd68c838-cbd2-44fe-ae7d-da4b87cd2ae4 req-26e0c341-6a65-4075-a1ab-0b8713fb2009 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:33.324657 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fd68c838-cbd2-44fe-ae7d-da4b87cd2ae4 req-26e0c341-6a65-4075-a1ab-0b8713fb2009 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:33.335877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-fd68c838-cbd2-44fe-ae7d-da4b87cd2ae4 req-26e0c341-6a65-4075-a1ab-0b8713fb2009 service nova] Creating event network-changed:836263e2-1319-4c1c-9ff3-124e27aadbde for instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 on hv-cinder-85236 Aug 08 18:14:33.341147 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-fd68c838-cbd2-44fe-ae7d-da4b87cd2ae4 req-26e0c341-6a65-4075-a1ab-0b8713fb2009 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031612 Aug 08 18:14:33.342029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 384/790] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:34.137717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:34.138463 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:34.145382 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:34.145908 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:34.146452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:34.147156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:34.147651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:34.148271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:34.292447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:34.301346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0f8f0559-641d-472d-8e54-abaf9e38b39f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.167539 Aug 08 18:14:34.304391 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 407/791] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:34 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:35.328943 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:35.329646 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:35.335980 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:35.336552 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:35.336984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:35.337672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:35.338176 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:35.338620 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:35.357277 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:35.474990 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:35.482847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f2bd1db7-0300-4974-a513-63fbf2c410e4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.159249 Aug 08 18:14:35.483969 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 385/792] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:35 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:36.064104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:36.064662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:36.071042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:36.071574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:36.071968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:36.072694 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:36.073154 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:36.073581 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:36.099139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Going to try to terminate instance {{(pid=118382) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:14:36.112372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=100 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:36.418457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-985b6e1f-6f1d-4ef7-bbc7-dcf36789deec tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "DELETE /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 204 len: 0 microversion: 2.1 time: 0.357843 Aug 08 18:14:36.419074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 408/793] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:14:36 2022] DELETE /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:14:36.428113 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:36.428754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:36.435327 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:36.435812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:36.436266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:36.436988 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:36.437444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:36.437869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:36.505386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:36.506089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:36.512051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:36.512568 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:36.513027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:36.513719 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:36.514169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:36.514752 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:36.598521 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:36.605254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dbea0eb7-0d68-4665-b853-d382d535bf06 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1507 microversion: 2.1 time: 0.181482 Aug 08 18:14:36.605827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 386/794] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:36 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:36.663472 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:36.671579 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-dcc56b07-7c83-4feb-ad57-48fad43c89d4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.169857 Aug 08 18:14:36.672143 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 409/795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:36 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:37.627071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:37.627602 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:37.633985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:37.634463 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:37.634895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:37.635570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:37.636018 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:37.636433 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:37.693606 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:37.694221 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:37.700589 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:37.701082 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:37.701519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:37.702209 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:37.702662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:37.703328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:37.813503 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:37.821259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7caa0830-7914-44dc-998a-93d9bcdb0b74 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1507 microversion: 2.1 time: 0.198621 Aug 08 18:14:37.821984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 387/796] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:37 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:37.859644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:37.867061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e3176169-b906-4bb7-aa68-8577c76f2a4c tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.177318 Aug 08 18:14:37.867627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 410/797] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:37 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:38.841822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:38.842474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:38.848971 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:38.849462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:38.849900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:38.850598 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:38.851052 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:38.851476 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:38.888593 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:38.889235 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:38.896318 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:38.896838 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:38.897279 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:38.897975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:38.898432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:38.898854 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:39.032168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:39.039582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-defeada8-4f5c-4850-b2c3-7c7d3f646887 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1507 microversion: 2.1 time: 0.201673 Aug 08 18:14:39.040151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 388/798] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:38 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:39.063336 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:39.070719 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-af9eee27-febf-4f00-8e18-833aedc10957 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.186055 Aug 08 18:14:39.073675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 411/799] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:38 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:39.243848 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:39.244369 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:39.250935 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:39.251426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:39.251869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:39.252607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:39.253052 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:39.253478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:39.277092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d6f68c37-df71-41a5-a852-374777ccdf46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/ips" status: 200 len: 151 microversion: 2.20 time: 0.141852 Aug 08 18:14:39.277839 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 389/800] 10.222.0.50 () {60 vars in 1289 bytes} [Mon Aug 8 18:14:39 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/ips => generated 151 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:14:39.649613 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-baab1f36-2ece-44ac-861e-ef3835e7820a req-278369ce-e865-442f-a7e3-ed3095e4b273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376e3874-5477-49ca-8bec-fa6e87c83c56", "name": "network-vif-deleted", "tag": "010eb5ef-3314-4f0e-8ce7-a04d853d274b"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:39.659349 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-baab1f36-2ece-44ac-861e-ef3835e7820a req-278369ce-e865-442f-a7e3-ed3095e4b273 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:39.660155 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-baab1f36-2ece-44ac-861e-ef3835e7820a req-278369ce-e865-442f-a7e3-ed3095e4b273 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:39.661015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-baab1f36-2ece-44ac-861e-ef3835e7820a req-278369ce-e865-442f-a7e3-ed3095e4b273 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:39.672314 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-baab1f36-2ece-44ac-861e-ef3835e7820a req-278369ce-e865-442f-a7e3-ed3095e4b273 service nova] Creating event network-vif-deleted:010eb5ef-3314-4f0e-8ce7-a04d853d274b for instance 376e3874-5477-49ca-8bec-fa6e87c83c56 on hv-cinder-85236 Aug 08 18:14:39.678149 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-baab1f36-2ece-44ac-861e-ef3835e7820a req-278369ce-e865-442f-a7e3-ed3095e4b273 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Aug 08 18:14:39.679260 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 412/801] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:40.062153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:40.062848 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:40.069321 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:40.069806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:40.070249 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:40.070937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:40.071392 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:40.071813 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:40.094153 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:40.094844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:40.101472 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:40.101988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:40.102418 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:40.102747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:40.103136 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:40.103250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:40.103585 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:40.103700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:40.104002 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:40.104104 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lazy-loading 'fault' on Instance uuid 376e3874-5477-49ca-8bec-fa6e87c83c56 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:14:40.147830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:40.156224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b15f1351-7158-4e6d-9d22-cdb57d7f6c61 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 200 len: 1311 microversion: 2.1 time: 0.098894 Aug 08 18:14:40.159647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 390/802] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:40 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:40.245010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:40.252604 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5577ddca-a56e-4530-9592-885fbef26e18 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.163135 Aug 08 18:14:40.253184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 413/803] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:40 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:40.333055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-c555fc71-9023-44fa-94ff-bfa8ba8d9102 req-497c84fb-c9a8-4d3f-8446-2d5fd06439f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d", "name": "network-vif-plugged", "status": "completed", "tag": "ba2a15cb-dff8-4775-9544-c1155b4411cf"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:40.342297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c555fc71-9023-44fa-94ff-bfa8ba8d9102 req-497c84fb-c9a8-4d3f-8446-2d5fd06439f1 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:40.343274 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c555fc71-9023-44fa-94ff-bfa8ba8d9102 req-497c84fb-c9a8-4d3f-8446-2d5fd06439f1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:40.343703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c555fc71-9023-44fa-94ff-bfa8ba8d9102 req-497c84fb-c9a8-4d3f-8446-2d5fd06439f1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:40.354763 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-c555fc71-9023-44fa-94ff-bfa8ba8d9102 req-497c84fb-c9a8-4d3f-8446-2d5fd06439f1 service nova] Creating event network-vif-plugged:ba2a15cb-dff8-4775-9544-c1155b4411cf for instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d on hv-cinder-85236 Aug 08 18:14:40.361172 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-c555fc71-9023-44fa-94ff-bfa8ba8d9102 req-497c84fb-c9a8-4d3f-8446-2d5fd06439f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083850 Aug 08 18:14:40.361957 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 391/804] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:41.176643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:41.177253 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 376e3874-5477-49ca-8bec-fa6e87c83c56] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:41.183572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.184043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.184469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.185165 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.185612 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.186030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.199509 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] HTTP exception thrown: Instance 376e3874-5477-49ca-8bec-fa6e87c83c56 could not be found. Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Request method failure captured: Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 HTTP/1.1 Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFBJBvNIm8XO1o8nN70rM82JzCWThocYUlsFdB_3inGl2Ht2Ok5s6cLQPQm16uUMwEw_YZovD4MX6nOwbs-9NOtLX3YCSTDvhVzznPguIbY9onCuhox29kZtgl8DnU-CYK2a7fiU_F3st4_DuOuelqdgPGett66k1D1zpaEJHLz88E Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:14:41.201159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_34b812a3f98747eeac35fbc27a342ab0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 4c7a6c1d08554db09d65394ec338f8b5 Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 376e3874-5477-49ca-8bec-fa6e87c83c56 could not be found. Aug 08 18:14:41.203617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '376e3874-5477-49ca-8bec-fa6e87c83c56'} Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 376e3874-5477-49ca-8bec-fa6e87c83c56 could not be found. Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:14:41.204567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 376e3874-5477-49ca-8bec-fa6e87c83c56 could not be found. Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 376e3874-5477-49ca-8bec-fa6e87c83c56 could not be found. Aug 08 18:14:41.206103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:41.207715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Returning 404 to user: Instance 376e3874-5477-49ca-8bec-fa6e87c83c56 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:14:41.207715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9350061c-3116-485b-a534-8c5a86bea1e9 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56" status: 404 len: 111 microversion: 2.1 time: 0.030355 Aug 08 18:14:41.207715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 414/805] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:41 2022] GET /compute/v2.1/servers/376e3874-5477-49ca-8bec-fa6e87c83c56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:14:41.212934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:41.213511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:41.219509 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.219984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.220417 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.221120 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.221570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.221986 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.245829 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:14:41.273668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:41.274336 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:41.280137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.280782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.281212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.281899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.282344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.282761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.414005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:41.422048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6b19a70e-e807-4744-aed4-793fda7e1eff tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.152254 Aug 08 18:14:41.422609 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 415/806] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:41 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:41.427405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:41.427882 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:41.433417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.433904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.434340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.435034 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.435491 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.435913 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.458413 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lazy-loading 'flavor' on Instance uuid 5ce432ca-7675-48f3-96a4-55aebc18503d {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:14:41.544258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b687621d-e73d-4f6c-9e27-f8d248f3c9c0 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 204 len: 0 microversion: 2.1 time: 0.335662 Aug 08 18:14:41.544876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 392/807] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:14:41 2022] DELETE /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:14:41.553534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:41.554219 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:41.560019 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.560491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.560952 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.562171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.562623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.563038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.694202 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:41.701882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b5166da9-0b7a-48cd-b137-0c359405f5c2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.152279 Aug 08 18:14:41.702444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 393/808] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:41 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:14:41.965780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-19a7f0bf-c2bb-4d7d-9af1-a54ba740c246 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/action" status: 202 len: 0 microversion: 2.20 time: 0.541981 Aug 08 18:14:41.966392 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 416/809] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Aug 8 18:14:41 2022] POST /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:14:41.974927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:41.975534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:41.981469 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.981948 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.982381 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:41.983683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:41.984157 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:41.984608 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:42.115584 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:42.123639 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:42.125197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:42.126363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b31f28ca-2fdd-48f1-b7fe-a43c8bd91cb9 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.155282 Aug 08 18:14:42.126925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 394/810] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:41 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:42.444289 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:42.445047 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:42.451526 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:42.452625 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:42.453067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:42.454058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:42.454545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:42.454963 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:42.584316 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:42.591740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-09df25aa-4ee7-4bee-8836-721c321967e6 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.152243 Aug 08 18:14:42.592303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 417/811] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:42 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:42.721807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:42.722420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:42.728795 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:42.729311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:42.729748 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:42.730434 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:42.730885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:42.731302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:42.862800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:42.870179 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a4351c55-b3aa-458b-9085-1d9752396021 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.152187 Aug 08 18:14:42.870742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 395/812] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:42 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:43.149909 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:43.150446 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:43.157158 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:43.157647 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:43.158083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:43.158798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:43.159303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:43.159725 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:43.285426 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:43.293234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:43.294738 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:43.296616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-613b65a6-7899-4e1e-86d1-c0340e26fb18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.150142 Aug 08 18:14:43.297182 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 418/813] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:43 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:43.612331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:43.613555 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:43.619750 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:43.620246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:43.620806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:43.621517 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:43.621973 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:43.622398 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:43.758175 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:43.766204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8b9501ab-c9f1-45fb-aabe-27269e5ebf45 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1575 microversion: 2.1 time: 0.157853 Aug 08 18:14:43.766767 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 396/814] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:43 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:43.892242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:43.892871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:43.899194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:43.899669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:43.900096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:43.900803 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:43.901284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:43.901694 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:44.275644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:44.283362 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6aaac5c5-841a-4455-bc39-f704c40818a2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.395586 Aug 08 18:14:44.283934 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 419/815] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:43 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:44.318762 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:44.319368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:44.325347 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:44.325827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:44.326255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:44.326986 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:44.327436 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:44.327858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:44.457432 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:44.465360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:44.466907 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:44.468197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1076d467-44db-4b94-91c3-cca77479f8ee tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.153386 Aug 08 18:14:44.468794 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 397/816] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:44 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:44.787373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:44.787900 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:44.794305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:44.794783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:44.795208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:44.795890 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:44.796334 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:44.797556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:44.931108 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:44.938500 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-47c910d9-89f9-48c3-b1d9-900239898ebe tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1562 microversion: 2.1 time: 0.155175 Aug 08 18:14:44.939059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 420/817] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:44 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:45.304856 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:45.305477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:45.311853 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:45.312345 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:45.312887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:45.313591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:45.314049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:45.314475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:45.491429 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:45.492066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:45.498055 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:45.498525 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:45.499468 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:45.500146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:45.500615 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:45.501029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:45.522394 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:45.529497 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c2b042db-2bea-4394-8490-62afe443eaf2 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1522 microversion: 2.1 time: 0.228544 Aug 08 18:14:45.530568 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 398/818] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:45 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:45.664475 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:45.672615 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:45.674107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:45.675261 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bf47adf9-66fe-4b54-b8ff-756a4223e4a7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.187951 Aug 08 18:14:45.676009 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 421/819] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:45 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:14:45.763066 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-28f351ee-ccb3-4ffc-9fe9-661470a5e302 req-5fe8615b-436c-4869-946f-efa429dd4527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ff23cf-cf95-4e92-8641-45756fed10ae", "name": "network-vif-deleted", "tag": "985fbb5e-9f16-43f2-bb21-2fb922c334d5"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:45.773298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-28f351ee-ccb3-4ffc-9fe9-661470a5e302 req-5fe8615b-436c-4869-946f-efa429dd4527 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:45.773789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-28f351ee-ccb3-4ffc-9fe9-661470a5e302 req-5fe8615b-436c-4869-946f-efa429dd4527 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:45.774225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-28f351ee-ccb3-4ffc-9fe9-661470a5e302 req-5fe8615b-436c-4869-946f-efa429dd4527 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:45.785205 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-28f351ee-ccb3-4ffc-9fe9-661470a5e302 req-5fe8615b-436c-4869-946f-efa429dd4527 service nova] Creating event network-vif-deleted:985fbb5e-9f16-43f2-bb21-2fb922c334d5 for instance 18ff23cf-cf95-4e92-8641-45756fed10ae on hv-cinder-85236 Aug 08 18:14:45.790239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-28f351ee-ccb3-4ffc-9fe9-661470a5e302 req-5fe8615b-436c-4869-946f-efa429dd4527 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030761 Aug 08 18:14:45.790813 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 399/820] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:46.549738 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:46.550351 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:46.556782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:46.557262 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:46.557695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:46.558374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:46.558824 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:46.559244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:46.589964 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:46.590371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:46.590810 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:46.591249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lazy-loading 'fault' on Instance uuid 18ff23cf-cf95-4e92-8641-45756fed10ae {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:14:46.633907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7a6c1d08554db09d65394ec338f8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b812a3f98747eeac35fbc27a342ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:46.642000 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-55a97053-b66d-44c9-95f6-beb82fa9c8a6 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 200 len: 1311 microversion: 2.1 time: 0.096670 Aug 08 18:14:46.642570 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 422/821] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:46 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:14:46.702545 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:46.704211 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:46.710949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:46.711565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:46.712007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:46.712781 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:46.713236 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:46.713649 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:46.845560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:46.853620 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:46.855057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:46.856225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1249f2a8-426e-4fcc-ad06-fd4567d5d6b0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.159216 Aug 08 18:14:46.856833 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 400/822] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:46 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:47.663900 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:47.664532 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] [instance: 18ff23cf-cf95-4e92-8641-45756fed10ae] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:47.671419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:47.671892 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:47.672319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:47.673028 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:47.673474 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:47.673889 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:47.676461 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:47.687451 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] HTTP exception thrown: Instance 18ff23cf-cf95-4e92-8641-45756fed10ae could not be found. Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Request method failure captured: Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae HTTP/1.1 Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFBJBvNIm8XO1o8nN70rM82JzCWThocYUlsFdB_3inGl2Ht2Ok5s6cLQPQm16uUMwEw_YZovD4MX6nOwbs-9NOtLX3YCSTDvhVzznPguIbY9onCuhox29kZtgl8DnU-CYK2a7fiU_F3st4_DuOuelqdgPGett66k1D1zpaEJHLz88E Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:14:47.689043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_34b812a3f98747eeac35fbc27a342ab0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/34b812a3f98747eeac35fbc27a342ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 34b812a3f98747eeac35fbc27a342ab0 Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953889771 Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 4c7a6c1d08554db09d65394ec338f8b5 Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953889771-project Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 18ff23cf-cf95-4e92-8641-45756fed10ae could not be found. Aug 08 18:14:47.694049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '18ff23cf-cf95-4e92-8641-45756fed10ae'} Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ff23cf-cf95-4e92-8641-45756fed10ae could not be found. Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:14:47.694923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ff23cf-cf95-4e92-8641-45756fed10ae could not be found. Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ff23cf-cf95-4e92-8641-45756fed10ae could not be found. Aug 08 18:14:47.696844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:14:47.698227 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] Returning 404 to user: Instance 18ff23cf-cf95-4e92-8641-45756fed10ae could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:14:47.698227 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3cbcdadc-625e-44d8-b39e-3c7189b8be59 tempest-ServerRescueNegativeTestJSON-953889771 tempest-ServerRescueNegativeTestJSON-953889771-project] 10.222.0.50 "GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae" status: 404 len: 111 microversion: 2.1 time: 0.030303 Aug 08 18:14:47.698227 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 423/823] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:14:47 2022] GET /compute/v2.1/servers/18ff23cf-cf95-4e92-8641-45756fed10ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:14:47.879019 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:47.879736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:47.886178 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:47.886665 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:47.887103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:47.887799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:47.888257 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:47.888712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:48.025846 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:48.033956 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:48.034948 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:48.036448 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:48.037779 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cebc6bf4-baf4-4420-8e41-a0fc3cb7d7c6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.162714 Aug 08 18:14:48.038345 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 401/824] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:47 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:49.060673 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:49.061959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:49.064654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:49.069742 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:49.070253 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:49.076243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:49.076243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:49.076243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:49.076243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:49.210161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:49.218789 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:49.220293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:49.221487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6bde9140-6687-45e3-b7d6-22798900abbe tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.164927 Aug 08 18:14:49.222068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 424/825] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:49 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:50.245234 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:50.245962 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:50.253359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:50.253844 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:50.254284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:50.254984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:50.255466 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:50.255889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:50.389871 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:50.399817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:50.401639 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:50.403159 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0375c6f2-9bbd-4a4c-8820-3f1dfab3c7c4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.162257 Aug 08 18:14:50.403911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 402/826] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:50 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:51.425103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:51.425637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:51.431967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:51.432438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:51.432899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:51.433573 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:51.434019 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:51.434431 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:51.565390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:51.573378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:51.574859 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:51.576006 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6bb5249f-831d-4514-9bd9-9542a2340251 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.154884 Aug 08 18:14:51.576600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 425/827] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:51 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:52.599869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:52.600582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:52.606893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:52.607390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:52.607830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:52.608641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:52.609100 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:52.609524 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:52.743011 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:52.750968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:52.752484 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:52.753674 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-24fdce02-2a96-4946-9854-d42c781649f1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.158135 Aug 08 18:14:52.754246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 403/828] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:52 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:53.776075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:53.779540 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:53.783715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:53.784208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:53.784685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:53.785384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:53.785838 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:53.786263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:53.924940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:53.933240 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:53.934853 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:53.936017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-04188aec-5fe5-4a72-b04d-9965661ee766 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.163880 Aug 08 18:14:53.936593 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 426/829] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:53 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:54.663330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:54.663850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:54.670749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:54.671180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:54.671623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:54.672317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:54.672812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:54.673237 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:54.696812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f20978cb-fa2c-4062-ab94-a0d1919d23af tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/ips" status: 200 len: 147 microversion: 2.1 time: 0.037275 Aug 08 18:14:54.701764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 404/830] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:14:54 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:54.959522 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:54.960184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:54.966540 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:54.967011 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:54.967437 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:54.968115 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:54.968596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:54.969073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:55.098679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:55.106627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:55.108662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:55.109819 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-943407e1-c133-46e9-9255-ed8995e1daf4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.154292 Aug 08 18:14:55.110379 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 427/831] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:54 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:56.132978 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:56.133570 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:56.140526 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:56.141024 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:56.141461 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:56.142194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:56.142658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:56.143073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:56.276542 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:56.284861 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:56.286641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:56.287816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-23bc3ed8-4ba6-44e3-b84a-98c963bb2a96 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1744 microversion: 2.20 time: 0.158960 Aug 08 18:14:56.288393 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 405/832] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:56 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:56.312738 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dfce845-e2a6-4f29-9b9f-d80d55b0b9f7"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:14:56.315284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:56.324600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:56.324600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:56.324600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:56.324600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:56.325016 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:56.325016 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:57.256944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fbffcf6d-7dec-4cd4-b6bc-e7af1b979179 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.948291 Aug 08 18:14:57.257721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 428/833] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:14:56 2022] POST /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments => generated 194 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:14:57.319623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:57.319623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:57.319623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:57.319623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:57.320477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:57.320477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:57.320695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:57.320968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:57.480310 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:57.489915 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:57.490258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:57.491451 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-987309c9-381c-49d6-871b-0f930a5ab3e4 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1744 microversion: 2.20 time: 0.184240 Aug 08 18:14:57.492004 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 406/834] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:57 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:58.517141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:58.518199 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:58.524899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:58.525623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:58.526056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:58.526946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:58.527390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:58.527994 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:58.666489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:58.677716 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:58.679530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:58.680927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-521f77ab-7c8b-4292-bc90-63f8e024b788 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.169416 Aug 08 18:14:58.681481 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 429/835] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:58 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:14:59.706577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:14:59.707622 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:14:59.710396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:14:59.715403 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:59.716103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:59.716712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:59.717492 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:14:59.718041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:14:59.718535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:14:59.875966 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:59.886320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:59.888979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:14:59.891123 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9b808848-d57b-420b-8bf7-5eaaac2b3772 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.191197 Aug 08 18:14:59.892462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 407/836] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:14:59 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:00.429538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-6915cb54-5b39-4456-85eb-a0c9e6f32b29 req-c465be9d-ace1-4cd4-a30f-c3423f4b806d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce432ca-7675-48f3-96a4-55aebc18503d", "name": "network-vif-plugged", "status": "completed", "tag": "7cc61064-033f-47bf-8688-67f7559828a2"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:00.441447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-6915cb54-5b39-4456-85eb-a0c9e6f32b29 req-c465be9d-ace1-4cd4-a30f-c3423f4b806d service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:00.442326 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-6915cb54-5b39-4456-85eb-a0c9e6f32b29 req-c465be9d-ace1-4cd4-a30f-c3423f4b806d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:00.442941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-6915cb54-5b39-4456-85eb-a0c9e6f32b29 req-c465be9d-ace1-4cd4-a30f-c3423f4b806d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:00.455544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-6915cb54-5b39-4456-85eb-a0c9e6f32b29 req-c465be9d-ace1-4cd4-a30f-c3423f4b806d service nova] Creating event network-vif-plugged:7cc61064-033f-47bf-8688-67f7559828a2 for instance 5ce432ca-7675-48f3-96a4-55aebc18503d on hv-cinder-85236 Aug 08 18:15:00.460850 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-6915cb54-5b39-4456-85eb-a0c9e6f32b29 req-c465be9d-ace1-4cd4-a30f-c3423f4b806d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034831 Aug 08 18:15:00.461654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 430/837] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:00.915189 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:00.916037 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:00.927194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:00.927965 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:00.928401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:00.929152 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:00.929645 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:00.930232 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:01.092638 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:01.103915 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:01.105499 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:01.106651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6b2dacc0-9cde-4341-aeda-72da17ec89c1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.196628 Aug 08 18:15:01.107243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 408/838] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:00 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:02.131739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:02.132353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:02.138459 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:02.138938 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:02.139367 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:02.140048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:02.140498 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:02.140944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:02.273739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:02.282837 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:02.284337 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:02.285603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c1b179df-ae44-4974-80c6-646e502e30fa tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.158662 Aug 08 18:15:02.286344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 431/839] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:02 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:03.308957 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:03.310344 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:03.317370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:03.318064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:03.318684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:03.319396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:03.319879 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:03.320491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:03.460094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:03.473979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:03.475565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:03.476754 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5fa570d0-6d45-4005-8060-b90d83e6ca49 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.171703 Aug 08 18:15:03.477467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 409/840] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:03 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:04.501280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:04.502134 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:04.512957 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:04.524283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:04.524283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:04.524283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:04.524283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:04.524792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:04.667282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:04.676599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:04.678214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:04.679489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-42523a01-753b-4972-bbf4-4e0a7771759f tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.183060 Aug 08 18:15:04.680135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 432/841] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:04 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:05.706879 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:05.708208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:05.719302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:05.720123 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:05.720818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:05.721775 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:05.722453 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:05.723448 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:05.993838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:06.012992 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:06.019942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:06.021683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d307eddf-db5f-4eb2-9c81-83cc9545629c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.322213 Aug 08 18:15:06.022892 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 410/842] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:05 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:06.116168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:06.119692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:06.140724 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:06.141529 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:06.142334 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:06.144003 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:06.144726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:06.145320 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:06.183876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e507c9e8-833f-4426-9cd5-318b67994c4f tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075053 Aug 08 18:15:06.184443 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 433/843] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:15:06 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:15:06.195942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:06.196458 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:06.203460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:06.204465 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:06.205121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:06.205994 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:06.206612 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:06.207196 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:06.259551 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-65f7fb05-3657-406d-8742-101c10976a1c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/8dfce845-e2a6-4f29-9b9f-d80d55b0b9f7" status: 200 len: 194 microversion: 2.1 time: 0.067643 Aug 08 18:15:06.260446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 411/844] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Aug 8 18:15:06 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/8dfce845-e2a6-4f29-9b9f-d80d55b0b9f7 => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:07.051945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:07.053721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:07.060710 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:07.061198 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:07.061685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:07.062422 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:07.062953 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:07.063391 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:07.234009 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:07.245056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:07.246949 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:07.249145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f59f4236-dab7-4b12-88aa-08aff087aa29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.201175 Aug 08 18:15:07.250283 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 434/845] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:07 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:07.994018 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a18bfff-6cc6-4f42-8a83-d5f25bd36e39"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:08.001659 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:08.014851 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:08.015816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:08.016578 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:08.023583 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:08.023583 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:08.023583 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:08.276043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:08.276043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:08.281855 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:08.282349 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:08.282785 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:08.283487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:08.284052 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:08.284371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:08.436905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:08.445761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:08.447493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:08.452644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5c23818a-109b-4bcf-ba1f-62b3ce9c04de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.178875 Aug 08 18:15:08.452644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 435/846] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:08 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:09.342785 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4d736410-63ae-4c8e-9a47-01d292c6418c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "POST /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.357291 Aug 08 18:15:09.345502 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 412/847] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:15:07 2022] POST /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments => generated 194 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:15:09.473946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:09.474636 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:09.484666 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:09.485943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:09.485943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:09.486933 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:09.487537 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:09.488229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:09.668726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:09.677599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:09.679366 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:09.680743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-03d0b273-c0da-4f2f-addf-08642b4efd58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.211930 Aug 08 18:15:09.681945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 436/848] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:09 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:10.707087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:10.710136 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:10.717225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:10.717939 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:10.718443 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:10.719405 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:10.719949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:10.720490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:10.854748 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:10.863239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:10.864764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:10.865918 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1d7117fb-83bb-474c-8260-e4d74ce7d192 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1739 microversion: 2.20 time: 0.164546 Aug 08 18:15:10.866475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 413/849] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:10 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:11.943653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:11.943653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:11.943653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:11.943653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:11.944427 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:11.944427 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:11.944427 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:11.944427 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:12.030541 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:12.038608 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:12.040015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:12.041199 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-13bcd144-5561-4840-95d3-f391be6b624c tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1721 microversion: 2.20 time: 0.156494 Aug 08 18:15:12.041752 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 437/850] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:11 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:13.064373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:13.065013 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:13.071652 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:13.072712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:13.072712 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:13.073338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:13.073842 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:13.074269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:13.206177 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:13.214244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:13.215749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:13.216935 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5a3852bc-12a5-4129-88d7-4dfd08b47e18 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1721 microversion: 2.20 time: 0.156536 Aug 08 18:15:13.217491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 414/851] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:13 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:14.241110 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:14.241952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:14.248457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:14.248987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:14.249933 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:14.250780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:14.251189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:14.251619 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:14.385043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:14.393117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:14.394717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:14.395962 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-db018ce9-5d00-490d-9577-1c98a1973c9a tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1664 microversion: 2.20 time: 0.159539 Aug 08 18:15:14.396607 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 438/852] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:14 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:14.415330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-fa9f4fec-b90a-4ce4-9e2b-6e8e463dc601 req-56cb926e-2e41-42a6-93f5-02b847ea902f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce432ca-7675-48f3-96a4-55aebc18503d", "name": "network-vif-unplugged", "status": "completed", "tag": "7cc61064-033f-47bf-8688-67f7559828a2"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:14.425650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa9f4fec-b90a-4ce4-9e2b-6e8e463dc601 req-56cb926e-2e41-42a6-93f5-02b847ea902f service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:14.426129 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa9f4fec-b90a-4ce4-9e2b-6e8e463dc601 req-56cb926e-2e41-42a6-93f5-02b847ea902f service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:14.426553 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa9f4fec-b90a-4ce4-9e2b-6e8e463dc601 req-56cb926e-2e41-42a6-93f5-02b847ea902f service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:14.426967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddfb0c8c-7e74-46bd-9f81-9f396f87556b"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:14.429394 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:14.435721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:14.436214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:14.436745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:14.437966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:14.438117 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.compute.server_external_events [req-fa9f4fec-b90a-4ce4-9e2b-6e8e463dc601 req-56cb926e-2e41-42a6-93f5-02b847ea902f service nova] Unable to find a host for instance 5ce432ca-7675-48f3-96a4-55aebc18503d. Dropping event network-vif-unplugged {{(pid=118381) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 18:15:14.438492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:14.438927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:14.439042 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-fa9f4fec-b90a-4ce4-9e2b-6e8e463dc601 req-56cb926e-2e41-42a6-93f5-02b847ea902f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027574 Aug 08 18:15:14.439566 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 415/853] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 08 18:15:14.519121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:15.395230 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ff1308cb-0f44-4b8a-9585-ecf26d2bae29 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.972389 Aug 08 18:15:15.395864 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 439/854] 10.222.0.50 () {62 vars in 1364 bytes} [Mon Aug 8 18:15:14 2022] POST /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/os-volume_attachments => generated 188 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 18:15:15.516068 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:15.516592 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:15.523137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:15.524333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:15.524333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:15.524809 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:15.525270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:15.525696 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:15.687204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:16.092480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-30c4c0f5-2ae2-422e-bb12-28cac2c83eb8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/os-volume_attachments/ddfb0c8c-7e74-46bd-9f81-9f396f87556b" status: 202 len: 0 microversion: 2.20 time: 0.580307 Aug 08 18:15:16.093123 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 416/855] 10.222.0.50 () {60 vars in 1457 bytes} [Mon Aug 8 18:15:15 2022] DELETE /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/os-volume_attachments/ddfb0c8c-7e74-46bd-9f81-9f396f87556b => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 18:15:16.159598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:16.162833 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:16.166700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:16.167191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:16.167628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:16.168328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:16.168845 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:16.169267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:16.204432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118382) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 18:15:16.524191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8f3e2d59-9a60-489b-bacb-8c0a94de4783 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "POST /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/action" status: 202 len: 0 microversion: 2.20 time: 0.369587 Aug 08 18:15:16.525190 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 440/856] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Aug 8 18:15:16 2022] POST /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:15:16.533212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:16.534373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:16.540322 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:16.540852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:16.541287 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:16.541979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:16.542439 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:16.542847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:16.675549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:16.683529 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:16.685076 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:16.691118 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-44e1c005-cf77-4ac9-bc37-71b7f367bfbd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1672 microversion: 2.20 time: 0.157027 Aug 08 18:15:16.691118 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 417/857] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:16 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:17.710267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:17.710953 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:17.716953 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:17.717438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:17.717910 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:17.718600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:17.719058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:17.719492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:17.858962 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:17.867312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:17.868995 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:17.869995 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8e249a0d-ff98-40ce-a96a-8010eb0673ea tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1674 microversion: 2.20 time: 0.164298 Aug 08 18:15:17.870622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 441/858] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:17 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:18.180950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:18.183230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:18.190861 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:18.191361 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:18.191801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:18.192495 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:18.193031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:18.193456 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:18.226858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8d86b866-a469-4293-8ca5-d9bbff81e171 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049877 Aug 08 18:15:18.227420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 418/859] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:15:18 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:18.386199 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:18.386698 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:18.393406 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:18.393902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:18.394341 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:18.395113 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:18.395917 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:18.396032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:18.426175 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-20c07b18-a56e-4442-8c47-590131f66da1 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/8dfce845-e2a6-4f29-9b9f-d80d55b0b9f7" status: 200 len: 194 microversion: 2.1 time: 0.043808 Aug 08 18:15:18.432261 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 442/860] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Aug 8 18:15:18 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/8dfce845-e2a6-4f29-9b9f-d80d55b0b9f7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:18.437586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:18.438282 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:18.444204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:18.444728 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:18.445170 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:18.445878 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:18.446330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:18.446755 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:18.527198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lazy-loading 'services' on Instance uuid 6c647968-93d3-4345-b600-4f295d1810ce {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:15:18.801867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0e83bea2-bb65-46d2-ba4d-33d6275b5d21 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/8dfce845-e2a6-4f29-9b9f-d80d55b0b9f7" status: 202 len: 0 microversion: 2.1 time: 0.367676 Aug 08 18:15:18.802504 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 419/861] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:15:18 2022] DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/8dfce845-e2a6-4f29-9b9f-d80d55b0b9f7 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:15:18.893489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:18.894083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:18.900410 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:18.900923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:18.901354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:18.902035 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:18.902483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:18.903011 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:19.051595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:19.059654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:19.069381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:19.069381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a83cd45a-9b7a-44b3-a7d1-acb55f53cdf1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.174162 Aug 08 18:15:19.069381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 443/862] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:18 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:20.088663 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:20.089999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:20.098092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:20.098646 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:20.099297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:20.100304 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:20.101047 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:20.101789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:20.125639 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:20.126302 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:20.128804 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:20.151750 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:20.152421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:20.156435 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:20.160685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:20.161367 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:20.163391 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:20.192841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-409be21b-b6ca-4699-a893-aadbc7a6c3fd tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/ips" status: 200 len: 150 microversion: 2.1 time: 0.073773 Aug 08 18:15:20.194237 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 444/863] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:15:20 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/ips => generated 150 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:15:20.289666 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:20.298373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:20.299885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:20.301289 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-03f5cf70-ad36-47b7-89da-98f87e380100 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.218923 Aug 08 18:15:20.304919 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 420/864] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:20 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:21.326155 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:21.326858 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:21.335457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:21.336038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:21.336574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:21.337601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:21.338120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:21.338552 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:21.512740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:21.522369 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:21.523909 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:21.525201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b7d4bd8b-4092-499e-a3b0-be2aeb32ed58 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.204677 Aug 08 18:15:21.526107 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 445/865] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:21 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:21.852302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bb1d744-ffd3-4bac-a632-7e9a48b8576a"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:21.856203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:21.865173 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:21.865669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:21.866373 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:21.867618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:21.868175 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:21.868901 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:22.549643 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:22.550315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:22.557523 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:22.562373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:22.562373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:22.562373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:22.562373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:22.562844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:22.755365 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:22.765930 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:22.768183 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:22.770755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-87e3ac26-b108-40ec-8281-2c18b6b4c29d tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.224525 Aug 08 18:15:22.770755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 446/866] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:22 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:23.799080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:23.799742 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:23.810370 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:23.811609 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:23.813217 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:23.813331 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:23.813731 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:23.814174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:23.991750 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:24.000184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:24.001660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:24.003048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bbecce72-ae57-4955-bfbf-720ef53563d1 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.208679 Aug 08 18:15:24.004266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 447/867] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:23 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:25.031384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:25.032132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:25.039017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:25.040065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:25.040740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:25.042056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:25.042843 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:25.043524 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:25.221358 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:25.230819 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:25.232346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:25.234320 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-89a0b24f-ddf8-4610-b3c8-fb2101d88da0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.208235 Aug 08 18:15:25.234888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 448/868] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:25 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:26.257818 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:26.259286 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:26.267233 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:26.267885 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:26.268382 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:26.269202 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:26.269668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:26.270099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:26.433032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:26.445454 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:26.446947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:26.448116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-982aad3d-d735-435f-9e4b-e2ae39e74a66 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.194290 Aug 08 18:15:26.448874 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 449/869] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:26 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:27.088143 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1254271823", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452"}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:27.142851 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] validate_networks() for None {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:15:27.459754 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:15:27.460346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:15:27.460720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:15:27.463704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:15:27.463704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:15:27.474530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:27.475030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:27.475470 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:27.476412 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:27.477110 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:27.477715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:27.497152 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Getting quotas for project af1141d05df449069acddcf5caf5a512. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:15:27.501940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Getting quotas for user b65df416c9784238bd37c29dde190037 and project af1141d05df449069acddcf5caf5a512. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:15:27.522738 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:15:27.525079 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:15:27.673044 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bebc012b-d552-4d1b-ad17-15480aa61d58 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589080 Aug 08 18:15:27.673846 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 450/870] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 18:15:27.689015 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:27.702447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:27.727032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:27.727817 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:27.728249 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:27.728971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:27.729420 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:27.729831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:28.130618 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:28.139390 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:28.141689 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:28.142938 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b55ffddf-baae-41ca-a3f8-b120ad630ee0 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.467912 Aug 08 18:15:28.143582 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 451/871] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:27 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:28.148114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7676c024-2219-48bc-99d4-33ecc6f86a64 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:28.148829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7676c024-2219-48bc-99d4-33ecc6f86a64 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:28.201779 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7676c024-2219-48bc-99d4-33ecc6f86a64 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:28.209735 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7676c024-2219-48bc-99d4-33ecc6f86a64 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1215 microversion: 2.1 time: 0.065039 Aug 08 18:15:28.210306 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 452/872] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:28 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:29.165951 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:29.166595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:29.173227 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:29.173719 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:29.175726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:29.175726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:29.175726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:29.176030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:29.303872 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:29.312596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:29.313868 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:29.315243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7a5039ab-d21a-46b5-92e9-63c4feebda46 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.153304 Aug 08 18:15:29.315813 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 453/873] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:29 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:29.320203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:29.325067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:29.335445 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:29.335980 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:29.336431 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:29.337171 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:29.337629 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:29.338055 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:29.407524 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:29.409942 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:29.415948 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6fd35161-a372-45a5-9eb6-77c338dbebb3 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1219 microversion: 2.1 time: 0.099183 Aug 08 18:15:29.416715 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 454/874] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:29 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:29.584518 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:29.585014 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:29.591688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:29.592165 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:29.592666 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:29.593435 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:29.593885 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:29.594303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:29.625305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0419c756-198d-455c-8cfc-1dd70fd5f1f2 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/9a18bfff-6cc6-4f42-8a83-d5f25bd36e39" status: 200 len: 194 microversion: 2.1 time: 0.044821 Aug 08 18:15:29.626346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 455/875] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Aug 8 18:15:29 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/9a18bfff-6cc6-4f42-8a83-d5f25bd36e39 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:15:29.636472 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:29.637152 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:29.644187 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:29.644544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:29.645047 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:29.645846 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:29.646303 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:29.646725 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:29.727777 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lazy-loading 'services' on Instance uuid 6c647968-93d3-4345-b600-4f295d1810ce {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:15:29.919984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-af0ff7c4-6808-4635-b0ae-e82e22d8d9a0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "POST /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.073132 Aug 08 18:15:29.920769 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 421/876] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:15:21 2022] POST /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments => generated 194 bytes in 8075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:29.943220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-39fa14a9-2b11-4b94-af47-2b6e9e99634c tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/9a18bfff-6cc6-4f42-8a83-d5f25bd36e39" status: 202 len: 0 microversion: 2.1 time: 0.310412 Aug 08 18:15:29.943827 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 456/877] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:15:29 2022] DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments/9a18bfff-6cc6-4f42-8a83-d5f25bd36e39 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:15:30.341125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:30.341125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:30.345773 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:30.346258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:30.346691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:30.347391 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:30.347845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:30.348316 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:30.437821 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:30.438657 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:30.445036 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:30.445647 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:30.446040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:30.446785 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:30.447242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:30.447660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:30.561421 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:30.571146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-37925788-17c7-4344-aa11-6e35302fdcf8 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1275 microversion: 2.1 time: 0.138615 Aug 08 18:15:30.571730 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 457/878] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:30 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:30.602023 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:30.610736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:30.612527 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:30.613745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7e72f372-4788-42d6-8de0-513c15c93a77 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.279381 Aug 08 18:15:30.614328 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 422/879] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:30 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:31.593846 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:31.594756 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:31.601004 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:31.605655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:31.605655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:31.605655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:31.605655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:31.606101 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:31.636460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:31.637365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:31.641835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=32 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:31.645356 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:31.645865 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:31.646315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:31.647024 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:31.647630 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:31.648065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:31.908695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:31.915982 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b8fdc9a4-8c80-412b-baa4-939154a2da21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.326401 Aug 08 18:15:31.916564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 458/880] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:31 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:32.025114 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:32.034091 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:32.035599 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:32.036805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-938bae63-dda4-4b08-871d-c417d1c3da41 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.404246 Aug 08 18:15:32.037372 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 423/881] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:31 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:32.939373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:32.940161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:32.946887 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:32.947549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:32.948168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:32.949030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:32.949596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:32.950256 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:33.065424 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:33.066303 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:33.072731 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:33.073223 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:33.073664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:33.074412 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:33.074871 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:33.075298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:33.133372 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:33.142531 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-83630a7f-f5ab-40fe-8fe5-00498fe90d21 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.207769 Aug 08 18:15:33.145843 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 459/882] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:32 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:33.276078 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:33.284406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:33.286119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:33.287360 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-488af4f1-7d1d-4a56-b5de-3ad5a874e1d6 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.226518 Aug 08 18:15:33.287988 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 424/883] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:33 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:33.350545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-26ac8492-d59e-40f9-9669-449e6192069b req-9ed437ba-3157-4903-ad52-ee3c8bfed506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf776dc-7937-4e82-a57a-f76a46434630", "tag": "d9e3f8b4-a2bb-4b06-8563-9c2545c4a300"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:33.360854 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-26ac8492-d59e-40f9-9669-449e6192069b req-9ed437ba-3157-4903-ad52-ee3c8bfed506 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:33.361336 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-26ac8492-d59e-40f9-9669-449e6192069b req-9ed437ba-3157-4903-ad52-ee3c8bfed506 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:33.361768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-26ac8492-d59e-40f9-9669-449e6192069b req-9ed437ba-3157-4903-ad52-ee3c8bfed506 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:33.373305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-26ac8492-d59e-40f9-9669-449e6192069b req-9ed437ba-3157-4903-ad52-ee3c8bfed506 service nova] Creating event network-changed:d9e3f8b4-a2bb-4b06-8563-9c2545c4a300 for instance 2cf776dc-7937-4e82-a57a-f76a46434630 on hv-cinder-85236 Aug 08 18:15:33.379984 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-26ac8492-d59e-40f9-9669-449e6192069b req-9ed437ba-3157-4903-ad52-ee3c8bfed506 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033429 Aug 08 18:15:33.380708 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 460/884] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:15:34.165912 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:34.166644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:34.173670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:34.174155 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:34.174592 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:34.175287 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:34.175745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:34.176201 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:34.311630 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:34.312487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:34.315960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:34.318744 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:34.320203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:34.320684 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:34.321398 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:34.321858 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:34.322287 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:34.323545 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4bef502f-7740-461e-9400-3627ef53e743 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.161777 Aug 08 18:15:34.324105 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 425/885] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:34 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:34.457692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:34.465885 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:34.467393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:34.469236 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-547bf7b4-21d9-42fa-a46e-dde8e05fc6fb tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.162487 Aug 08 18:15:34.475152 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 461/886] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:34 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:34.560749 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-2e799ab7-f870-44a3-8926-369daa112fe6 req-6ae905e4-78ba-47bf-950a-84816126a7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce432ca-7675-48f3-96a4-55aebc18503d", "name": "network-vif-plugged", "status": "completed", "tag": "7cc61064-033f-47bf-8688-67f7559828a2"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:34.570518 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-2e799ab7-f870-44a3-8926-369daa112fe6 req-6ae905e4-78ba-47bf-950a-84816126a7a1 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:34.571043 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-2e799ab7-f870-44a3-8926-369daa112fe6 req-6ae905e4-78ba-47bf-950a-84816126a7a1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:34.571474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-2e799ab7-f870-44a3-8926-369daa112fe6 req-6ae905e4-78ba-47bf-950a-84816126a7a1 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:34.582940 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-2e799ab7-f870-44a3-8926-369daa112fe6 req-6ae905e4-78ba-47bf-950a-84816126a7a1 service nova] Creating event network-vif-plugged:7cc61064-033f-47bf-8688-67f7559828a2 for instance 5ce432ca-7675-48f3-96a4-55aebc18503d on hv-cinder-85236 Aug 08 18:15:34.588448 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-2e799ab7-f870-44a3-8926-369daa112fe6 req-6ae905e4-78ba-47bf-950a-84816126a7a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031479 Aug 08 18:15:34.589058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 426/887] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:35.344536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:35.345161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:35.351611 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:35.354983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:35.354983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:35.354983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:35.354983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:35.355478 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:35.482555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:35.490127 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5089fd97-0ea8-40db-87ec-06a39b84135d tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.149469 Aug 08 18:15:35.490688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 462/888] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:35 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:35.492008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:35.492724 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:35.499290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:35.499729 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:35.500159 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:35.500859 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:35.501305 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:35.501728 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:35.627700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:35.635617 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:35.637163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:35.638326 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-19c0ff37-70b1-47ca-bea5-4b1302b59c60 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.151000 Aug 08 18:15:35.638882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 427/889] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:35 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:36.511729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:36.512354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:36.519697 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:36.520293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:36.520759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:36.521687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:36.522153 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:36.522577 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:36.666845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:36.667641 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:36.669311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:36.676431 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2a311af0-8fe5-4029-add6-0134388a0936 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.168412 Aug 08 18:15:36.677408 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 463/890] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:36 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:36.679444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:36.679931 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:36.680419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:36.681654 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:36.682199 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:36.682680 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:36.823200 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:36.832843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:36.833970 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:36.835267 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6dd02aab-18bd-4390-9578-08704d863615 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.176706 Aug 08 18:15:36.850307 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 428/891] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:36 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:37.698980 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:37.699599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:37.701563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:37.707639 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:37.708126 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:37.708605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:37.709306 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:37.709765 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:37.710191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:37.846366 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:37.853214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6b1f9a0b-2543-4c9b-8a9a-f9d9ff6ee57f tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.158079 Aug 08 18:15:37.854039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 464/892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:37 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:37.859064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:37.859668 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:37.866312 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:37.875224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:37.875224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:37.875224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:37.875224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:37.875641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:38.001852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:38.009882 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:38.012722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:38.012722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-41a23626-e70e-46a9-bce9-ca25ff6ededf tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1730 microversion: 2.20 time: 0.157757 Aug 08 18:15:38.013116 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 429/893] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:37 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:15:38.632616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-ad748b1a-5ba2-4dfb-afc8-b8d6ccfde36e req-071d503d-6e8e-4abd-9785-d3fb2147cc1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf776dc-7937-4e82-a57a-f76a46434630", "name": "network-vif-plugged", "status": "completed", "tag": "d9e3f8b4-a2bb-4b06-8563-9c2545c4a300"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:38.637530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=8 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:38.643807 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-ad748b1a-5ba2-4dfb-afc8-b8d6ccfde36e req-071d503d-6e8e-4abd-9785-d3fb2147cc1e service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:38.644420 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-ad748b1a-5ba2-4dfb-afc8-b8d6ccfde36e req-071d503d-6e8e-4abd-9785-d3fb2147cc1e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:38.644976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-ad748b1a-5ba2-4dfb-afc8-b8d6ccfde36e req-071d503d-6e8e-4abd-9785-d3fb2147cc1e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:38.653863 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:38.654366 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:38.658733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-ad748b1a-5ba2-4dfb-afc8-b8d6ccfde36e req-071d503d-6e8e-4abd-9785-d3fb2147cc1e service nova] Creating event network-vif-plugged:d9e3f8b4-a2bb-4b06-8563-9c2545c4a300 for instance 2cf776dc-7937-4e82-a57a-f76a46434630 on hv-cinder-85236 Aug 08 18:15:38.663590 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:38.663882 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-ad748b1a-5ba2-4dfb-afc8-b8d6ccfde36e req-071d503d-6e8e-4abd-9785-d3fb2147cc1e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034856 Aug 08 18:15:38.664085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:38.664499 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 465/894] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:38.664744 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:38.665642 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:38.666311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:38.666814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:38.749980 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lazy-loading 'services' on Instance uuid 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:15:38.753469 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:38.875329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:38.876061 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:38.887839 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:38.890009 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:38.890009 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:38.890009 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:38.890677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:38.891160 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:38.973815 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-faea0c3e-aaf4-4d01-a196-f2462d813855 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments/7bb1d744-ffd3-4bac-a632-7e9a48b8576a" status: 202 len: 0 microversion: 2.1 time: 0.326587 Aug 08 18:15:38.974946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 430/895] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:15:38 2022] DELETE /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments/7bb1d744-ffd3-4bac-a632-7e9a48b8576a => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:15:38.984775 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:38.987206 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:38.993470 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:38.993950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.000163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.000163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.000163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.000163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.029856 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1893dcd7-7474-445a-a682-f30310b854c6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049323 Aug 08 18:15:39.031209 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 431/896] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:15:38 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:15:39.035722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:39.036329 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:39.042396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.042896 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.043336 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.044030 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.044706 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.045145 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.068309 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:39.076424 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cc88f01f-080b-457c-ab56-108b4220db18 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.206023 Aug 08 18:15:39.091112 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 466/897] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:38 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:39.201279 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:39.210191 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:39.211787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:39.212967 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cef462b8-6942-4901-9796-f85b2f560684 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1717 microversion: 2.20 time: 0.181014 Aug 08 18:15:39.213519 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 432/898] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:15:39 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:15:39.624651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:39.626830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:39.633053 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.633544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.633983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.634685 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.635146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.635632 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.665297 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-852fcc60-7e9c-4eba-8943-608f349ec658 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044608 Aug 08 18:15:39.665898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 467/899] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:15:39 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:15:39.776595 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:39.778664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:39.785867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.786355 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.786798 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.787494 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.787990 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.788423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.817511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cd8bbb2c-04de-4944-9813-3ee5e6e06a6e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044874 Aug 08 18:15:39.818099 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 433/900] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:15:39 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:15:39.879230 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:39.879754 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:39.886269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.891436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.891436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.891436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:39.891436 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:39.891791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:39.916257 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Going to try to terminate instance {{(pid=118382) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:15:40.042747 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:40.045004 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:40.052119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:40.052645 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:40.053086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:40.053789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:40.054246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:40.054673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:40.084476 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2ff56596-4c09-49cd-9474-fb7639466352 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Aug 08 18:15:40.085048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 434/901] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:15:40 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:15:40.097909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:40.098640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:40.104740 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:40.110045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:40.110045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:40.110045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:40.110045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:40.110422 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:40.236490 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bff9fbf7-97f3-407b-bb31-9d92cec2b51a tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 204 len: 0 microversion: 2.1 time: 0.360760 Aug 08 18:15:40.237111 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 468/902] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:39 2022] DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:15:40.245902 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:40.246395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:40.246848 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:40.253930 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:40.254424 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:40.254858 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:40.255570 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:40.256027 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:40.256640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-093beea8-c750-482c-966b-db46e5f4aff9 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.161887 Aug 08 18:15:40.256959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:40.267105 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 435/903] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:40 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:40.397977 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:40.406241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d155839b-71f9-4e23-9783-a6af57411fdb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1675 microversion: 2.1 time: 0.164711 Aug 08 18:15:40.406801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 469/904] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:40 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:41.097041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:41.099367 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:41.105672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:41.106155 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:41.106592 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:41.107330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:41.107783 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:41.108204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:41.136337 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c698d9f9-ff23-48ff-92a8-87a48c88f8ce tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Aug 08 18:15:41.137065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 436/905] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:15:41 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:41.277975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:41.278592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:41.285696 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:41.286180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:41.286622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:41.287312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:41.287773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:41.288201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:41.302817 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:41.419908 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:41.427404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4a03cd05-b7f2-4771-bcb8-12c219dc7468 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1315 microversion: 2.1 time: 0.153350 Aug 08 18:15:41.427951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:41.428066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 470/906] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:41 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:41.428606 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:41.434555 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:41.435040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:41.435477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:41.436664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:41.437129 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:41.437550 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:41.563745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:41.571106 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ff5b5a53-5f34-4d25-a238-52ae67f34507 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1675 microversion: 2.1 time: 0.147106 Aug 08 18:15:41.571668 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 437/907] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:41 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:42.150595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:42.152758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:42.158853 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.159403 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.159856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.161610 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.161610 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.161610 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.190024 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0af0bcb2-b1ea-46ba-8863-b847daa55043 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044820 Aug 08 18:15:42.190580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 471/908] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Aug 8 18:15:42 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 18:15:42.251395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:42.251894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:42.258196 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.258684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.259125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.259819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.260279 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.260739 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.286370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:15:42.448040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:42.448582 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:42.455243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.456213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.456213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.456936 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.457409 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.457824 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.529032 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3749d650-34cb-4f7e-932a-752af970a112 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 204 len: 0 microversion: 2.1 time: 0.281457 Aug 08 18:15:42.529915 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 438/909] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:42 2022] DELETE /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:15:42.539533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:42.540229 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:42.546394 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.546835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.547271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.547962 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.548456 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.549001 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.630559 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:42.639881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c42dbc05-f0f4-4a2f-9731-6b9f4610b630 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1465 microversion: 2.1 time: 0.195165 Aug 08 18:15:42.640814 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 472/910] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:42 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1465 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:42.645736 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:42.646545 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:42.653171 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.653880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.654710 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.656346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.656982 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.657554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.805391 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:42.813496 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1db2ff9c-ebd7-41ce-89e9-2dab273a33dc tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1680 microversion: 2.1 time: 0.278339 Aug 08 18:15:42.814071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 439/911] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:42 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1680 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:42.818868 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:42.819367 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:42.825218 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.825714 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.826152 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.826908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:42.827883 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:42.828310 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:42.853598 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:15:42.949299 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:42.958344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0b1c13cc-b7b7-4959-a919-db9e630daa45 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1675 microversion: 2.1 time: 0.316269 Aug 08 18:15:42.959054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 473/912] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:42 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1675 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:43.104874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-072a962f-f65b-493e-90cb-5a2b3ae18e70 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 204 len: 0 microversion: 2.1 time: 0.289484 Aug 08 18:15:43.105507 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 440/913] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:42 2022] DELETE /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:15:43.114328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:43.114961 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:43.120973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:43.121447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:43.121875 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:43.122550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:43.122996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:43.123411 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:43.308974 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:43.316553 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9d004aaa-94f2-45ee-83e2-1c9d8ba93531 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1471 microversion: 2.1 time: 0.206164 Aug 08 18:15:43.317882 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 474/914] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:43 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:43.735701 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-df2d75e6-91c1-49d3-882e-fcf003aa66ae req-2980ff68-ff6b-474f-b6ec-f47bbd6a04a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c647968-93d3-4345-b600-4f295d1810ce", "name": "network-vif-deleted", "tag": "afd9a122-f426-43dd-9ada-811fd32407df"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:43.745579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-df2d75e6-91c1-49d3-882e-fcf003aa66ae req-2980ff68-ff6b-474f-b6ec-f47bbd6a04a9 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:43.746050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-df2d75e6-91c1-49d3-882e-fcf003aa66ae req-2980ff68-ff6b-474f-b6ec-f47bbd6a04a9 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:43.749433 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-df2d75e6-91c1-49d3-882e-fcf003aa66ae req-2980ff68-ff6b-474f-b6ec-f47bbd6a04a9 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:43.758701 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-df2d75e6-91c1-49d3-882e-fcf003aa66ae req-2980ff68-ff6b-474f-b6ec-f47bbd6a04a9 service nova] Creating event network-vif-deleted:afd9a122-f426-43dd-9ada-811fd32407df for instance 6c647968-93d3-4345-b600-4f295d1810ce on hv-cinder-85236 Aug 08 18:15:43.763676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-df2d75e6-91c1-49d3-882e-fcf003aa66ae req-2980ff68-ff6b-474f-b6ec-f47bbd6a04a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032226 Aug 08 18:15:43.765083 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 441/915] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:43.834691 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:43.835304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:43.841745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:43.842231 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:43.843197 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:43.843892 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:43.844342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:43.844837 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:43.979735 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:43.984623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:43.985391 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:43.986672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:43.987161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:43.987600 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:43.988315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:43.988790 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:43.989395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:43.994572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-fd798efb-755b-412c-98db-e14dc3cf545b tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1680 microversion: 2.1 time: 0.163769 Aug 08 18:15:43.995243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 475/916] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:43 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:44.056626 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:44.064284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-15b5128c-0a03-46e9-8da0-3aa84b2f452e tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1608 microversion: 2.1 time: 0.088713 Aug 08 18:15:44.075490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 442/917] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:43 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1608 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:44.338448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:44.339062 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:44.345597 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:44.346081 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:44.346520 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:44.347194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:44.347650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:44.348071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:44.481990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:44.491113 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ddee518c-aeed-4a1a-89f5-ee4ff1160f2b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1471 microversion: 2.1 time: 0.156454 Aug 08 18:15:44.491684 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 476/918] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:44 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:45.018761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:45.019314 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:45.025901 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:45.026388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:45.026827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:45.027520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:45.027978 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:45.028404 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:45.085914 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:45.086613 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:45.093321 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:45.093896 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:45.094395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:45.095252 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:45.095769 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:45.096256 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:45.157765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:45.165321 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3141bd09-ef27-49d1-9c10-8d31a980ad05 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1680 microversion: 2.1 time: 0.151014 Aug 08 18:15:45.165903 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 443/919] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:45 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:45.219675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:45.227346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5e6aa3d6-510a-4f35-95ea-89713b7369bb tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1323 microversion: 2.1 time: 0.145355 Aug 08 18:15:45.227915 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 477/920] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:45 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1323 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:45.511518 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:45.512134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:45.518647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:45.519135 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:45.519580 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:45.520275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:45.520765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:45.521195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:45.536527 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:45.660819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:45.671559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f70a7e74-d3ee-437a-939f-20869b3afb06 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1471 microversion: 2.1 time: 0.163795 Aug 08 18:15:45.672132 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 444/921] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:45 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:46.186998 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:46.187620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:46.193881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:46.194368 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:46.194806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:46.195598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:46.196035 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:46.196798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:46.248349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:46.249599 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:46.256220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:46.256798 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:46.257236 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:46.257934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:46.258391 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:46.259028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:46.289650 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:46.289954 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:46.290420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:46.290852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lazy-loading 'fault' on Instance uuid 6c647968-93d3-4345-b600-4f295d1810ce {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:15:46.405582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf8d88ca4da4515bd9f1bec64da3375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de58eb192de494b809a04e638e2a291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:46.412579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-75c3f55a-3762-4b78-90f0-5ec79d642a94 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 200 len: 1328 microversion: 2.1 time: 0.168656 Aug 08 18:15:46.413414 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 445/922] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:46 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 1328 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:46.529422 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:46.537517 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-30de5262-6d55-4689-9de6-dd481b69a38d tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1680 microversion: 2.1 time: 0.355472 Aug 08 18:15:46.538092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 478/923] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:46 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1680 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:46.693283 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:46.694254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:46.700242 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:46.700886 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:46.701333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:46.702696 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:46.703107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:46.703530 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:46.982526 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:46.990850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-54af5022-8182-48a1-af07-0af9e06d33d2 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1471 microversion: 2.1 time: 0.301482 Aug 08 18:15:47.000700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 446/924] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:46 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:47.131798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-3e12fa10-a84a-4514-9d3e-f06f7cf14815 req-daeff4c2-edc4-4c16-8336-60e65cdc1035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf776dc-7937-4e82-a57a-f76a46434630", "name": "network-vif-deleted", "tag": "d9e3f8b4-a2bb-4b06-8563-9c2545c4a300"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:47.142555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-3e12fa10-a84a-4514-9d3e-f06f7cf14815 req-daeff4c2-edc4-4c16-8336-60e65cdc1035 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:47.143166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-3e12fa10-a84a-4514-9d3e-f06f7cf14815 req-daeff4c2-edc4-4c16-8336-60e65cdc1035 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:47.143467 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-3e12fa10-a84a-4514-9d3e-f06f7cf14815 req-daeff4c2-edc4-4c16-8336-60e65cdc1035 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:47.155680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-3e12fa10-a84a-4514-9d3e-f06f7cf14815 req-daeff4c2-edc4-4c16-8336-60e65cdc1035 service nova] Creating event network-vif-deleted:d9e3f8b4-a2bb-4b06-8563-9c2545c4a300 for instance 2cf776dc-7937-4e82-a57a-f76a46434630 on hv-cinder-85236 Aug 08 18:15:47.160937 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-3e12fa10-a84a-4514-9d3e-f06f7cf14815 req-daeff4c2-edc4-4c16-8336-60e65cdc1035 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 Aug 08 18:15:47.161546 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 479/925] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:47.434432 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:47.435121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:47.442167 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:47.442655 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:47.443094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:47.443799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:47.444323 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:47.444778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:47.470614 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] HTTP exception thrown: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Request method failure captured: Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce HTTP/1.1 Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VFB2aP0d-tmHv9AIMpSDq23E4e3i0ZCrnrXcvNeD4l9XlxeB2npYYpGrr62VxEXJePllCtUF3dOhlaPMwIrKXCwxCdJee6oSJ8GqDZBNbKAvUjMjmJJpmo7DdEJzF1JeD7022Lp2FPU6O3lb8lkGX6gpdXkXzE8WQS5KQ3q0i9Tjdk Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:15:47.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5de58eb192de494b809a04e638e2a291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5de58eb192de494b809a04e638e2a291", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: caf8d88ca4da4515bd9f1bec64da3375 Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:47.474107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '6c647968-93d3-4345-b600-4f295d1810ce'} Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:47.474955 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:47.476272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:47.477709 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Returning 404 to user: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:47.477709 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9d1df255-54a5-446d-a8be-1a8f0721e0ef tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 404 len: 111 microversion: 2.1 time: 0.043324 Aug 08 18:15:47.477709 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 447/926] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:47 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:47.489204 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f944f2aa-5cd4-4a9c-bdd2-ee7e456f8b27 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '.version_select at 0x7f21ac7961f0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:47.558429 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:47.559150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:47.565633 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:47.566133 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:47.566574 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:47.567283 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:47.567739 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:47.568275 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:47.575022 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f944f2aa-5cd4-4a9c-bdd2-ee7e456f8b27 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415172423" status: 202 len: 0 microversion: 2.1 time: 0.095511 Aug 08 18:15:47.575793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 480/927] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Aug 8 18:15:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415172423 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:15:47.651151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:47.659656 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f24e8fd3-b22e-4004-97be-483b7c2abe7a tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1613 microversion: 2.1 time: 0.105077 Aug 08 18:15:47.660426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 448/928] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:47 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1613 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:15:48.012601 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:48.013603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:48.022208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:48.023139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:48.023824 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:48.024824 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:48.025548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:48.026132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:48.057493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:15:48.064473 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:48.068242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:48.068242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:48.068242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lazy-loading 'fault' on Instance uuid 2cf776dc-7937-4e82-a57a-f76a46434630 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:15:48.134474 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65df416c9784238bd37c29dde190037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1141d05df449069acddcf5caf5a512', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:48.142712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d7901a2d-7dff-4106-8fea-d8c1430ef75b tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 200 len: 1305 microversion: 2.1 time: 0.134039 Aug 08 18:15:48.143292 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 481/929] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:48 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:48.681951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:48.682630 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:48.689867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:48.690352 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:48.690788 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:48.691488 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:48.691937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:48.692357 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:48.723397 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:48.723890 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:48.724331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:48.724817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lazy-loading 'fault' on Instance uuid 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:15:48.769446 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d5e7d5c77084705b1f39406293ab585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0061f213bfd4e3b87a0582b6cec6487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:15:48.776475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-998f9d10-a04c-4b91-9fb4-5543efd1b970 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 200 len: 1330 microversion: 2.1 time: 0.098609 Aug 08 18:15:48.780381 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 449/930] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:48 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:15:49.164815 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:49.165485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] [instance: 2cf776dc-7937-4e82-a57a-f76a46434630] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:49.173208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:49.173892 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:49.174331 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:49.175024 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:49.175246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-6cb64a11-11f7-412f-9a1a-b76e079a2906 req-1dd3d05b-283a-447b-95d6-e2bb9ecf8774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed37849-c0e9-4d24-a56d-ecdd9bce3532", "name": "network-vif-deleted", "tag": "836263e2-1319-4c1c-9ff3-124e27aadbde"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:15:49.175477 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:49.175897 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:49.184595 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-6cb64a11-11f7-412f-9a1a-b76e079a2906 req-1dd3d05b-283a-447b-95d6-e2bb9ecf8774 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:49.185072 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-6cb64a11-11f7-412f-9a1a-b76e079a2906 req-1dd3d05b-283a-447b-95d6-e2bb9ecf8774 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:49.185504 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-6cb64a11-11f7-412f-9a1a-b76e079a2906 req-1dd3d05b-283a-447b-95d6-e2bb9ecf8774 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:49.190018 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] HTTP exception thrown: Instance 2cf776dc-7937-4e82-a57a-f76a46434630 could not be found. Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Request method failure captured: Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 HTTP/1.1 Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VK9ltnQoyMOwUxUPf7BrdLOB_G5ZK5yVUwZZ8HjRuiIiSIi4s_icUVRvzD92ZxrISPvIMcbugvICkPfsub90O_2JN5r_jRYlUNkaVV3YewhM2Va7zyvsL1jKevl6jBmicUb5PxoL15FivbF81VarNUzwWJ_RT1LF2eRvXk_buk9xC4 Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: af1141d05df449069acddcf5caf5a512 Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesNegativeTest-1481060022 Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:15:49.191695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/af1141d05df449069acddcf5caf5a512"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_af1141d05df449069acddcf5caf5a512", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/af1141d05df449069acddcf5caf5a512"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/af1141d05df449069acddcf5caf5a512"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesNegativeTest-1481060022 Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: af1141d05df449069acddcf5caf5a512 Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesNegativeTest-1481060022 Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesNegativeTest-1481060022-project Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: b65df416c9784238bd37c29dde190037 Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesNegativeTest-1481060022-project Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 2cf776dc-7937-4e82-a57a-f76a46434630 could not be found. Aug 08 18:15:49.193450 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '2cf776dc-7937-4e82-a57a-f76a46434630'} Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf776dc-7937-4e82-a57a-f76a46434630 could not be found. Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:49.194617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf776dc-7937-4e82-a57a-f76a46434630 could not be found. Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf776dc-7937-4e82-a57a-f76a46434630 could not be found. Aug 08 18:15:49.196064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.197230 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] Returning 404 to user: Instance 2cf776dc-7937-4e82-a57a-f76a46434630 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:49.197230 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d9bf7fc3-0fc6-41e6-af57-aeb715528072 tempest-VolumesNegativeTest-1481060022 tempest-VolumesNegativeTest-1481060022-project] 10.222.0.50 "GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630" status: 404 len: 111 microversion: 2.1 time: 0.032672 Aug 08 18:15:49.197681 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-6cb64a11-11f7-412f-9a1a-b76e079a2906 req-1dd3d05b-283a-447b-95d6-e2bb9ecf8774 service nova] Creating event network-vif-deleted:836263e2-1319-4c1c-9ff3-124e27aadbde for instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 on hv-cinder-85236 Aug 08 18:15:49.198979 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 482/931] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:49 2022] GET /compute/v2.1/servers/2cf776dc-7937-4e82-a57a-f76a46434630 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:49.205049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-6cb64a11-11f7-412f-9a1a-b76e079a2906 req-1dd3d05b-283a-447b-95d6-e2bb9ecf8774 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033819 Aug 08 18:15:49.205785 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 450/932] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:15:49.798353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:49.799087 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:49.805998 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:49.806485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:49.806926 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:49.807626 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:49.808087 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:49.808530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:49.823423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 HTTP/1.1 Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:15:49.825483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:49.827834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '7ed37849-c0e9-4d24-a56d-ecdd9bce3532'} Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:49.828707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:49.830220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:49.831344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:49.831344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e8804158-f443-42d7-8749-f928fd0e1dd7 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 404 len: 111 microversion: 2.1 time: 0.033185 Aug 08 18:15:49.831344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 483/933] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:49 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:49.837456 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-05f2515f-3f8a-453f-ad2f-0ce3760a54ba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '.version_select at 0x7f21acdf9160>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:49.946544 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-05f2515f-3f8a-453f-ad2f-0ce3760a54ba tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-279857732" status: 202 len: 0 microversion: 2.1 time: 0.113335 Aug 08 18:15:49.947053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 451/934] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Aug 8 18:15:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-279857732 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:15:50.958712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:50.959209 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:50.968319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:50.968319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:50.968319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:50.968319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:50.968828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:50.968828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:50.981888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] HTTP exception thrown: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Request method failure captured: Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce HTTP/1.1 Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFB2aP0d-tmHv9AIMpSDq23E4e3i0ZCrnrXcvNeD4l9XlxeB2npYYpGrr62VxEXJePllCtUF3dOhlaPMwIrKXCwxCdJee6oSJ8GqDZBNbKAvUjMjmJJpmo7DdEJzF1JeD7022Lp2FPU6O3lb8lkGX6gpdXkXzE8WQS5KQ3q0i9Tjdk Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:15:50.983888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5de58eb192de494b809a04e638e2a291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5de58eb192de494b809a04e638e2a291", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: caf8d88ca4da4515bd9f1bec64da3375 Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:50.985631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '6c647968-93d3-4345-b600-4f295d1810ce'} Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:50.986516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:50.988086 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:50.992083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Returning 404 to user: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:50.992083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-27763848-2df8-4b31-b85d-79b06e781740 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 404 len: 111 microversion: 2.1 time: 0.031222 Aug 08 18:15:50.992083 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 484/935] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:50 2022] DELETE /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:50.993848 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:50.994591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 6c647968-93d3-4345-b600-4f295d1810ce] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:51.002256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:51.002740 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:51.003178 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:51.003868 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:51.004324 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:51.004772 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:51.018763 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] HTTP exception thrown: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Request method failure captured: Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce HTTP/1.1 Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VFB2aP0d-tmHv9AIMpSDq23E4e3i0ZCrnrXcvNeD4l9XlxeB2npYYpGrr62VxEXJePllCtUF3dOhlaPMwIrKXCwxCdJee6oSJ8GqDZBNbKAvUjMjmJJpmo7DdEJzF1JeD7022Lp2FPU6O3lb8lkGX6gpdXkXzE8WQS5KQ3q0i9Tjdk Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:15:51.020203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5de58eb192de494b809a04e638e2a291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5de58eb192de494b809a04e638e2a291", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: caf8d88ca4da4515bd9f1bec64da3375 Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:51.021818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '6c647968-93d3-4345-b600-4f295d1810ce'} Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:51.023074 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. Aug 08 18:15:51.024533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:51.026031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Returning 404 to user: Instance 6c647968-93d3-4345-b600-4f295d1810ce could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:51.026031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4a2f3765-3700-4fe3-93ee-685fea78e0b6 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce" status: 404 len: 111 microversion: 2.1 time: 0.031583 Aug 08 18:15:51.026031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 452/936] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:50 2022] GET /compute/v2.1/servers/6c647968-93d3-4345-b600-4f295d1810ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:52.004320 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:52.004865 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:52.011688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:52.012212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:52.012625 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:52.013325 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:52.013785 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:52.014211 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:52.030499 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 HTTP/1.1 Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:15:52.032065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.033809 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '7ed37849-c0e9-4d24-a56d-ecdd9bce3532'} Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:52.034734 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.036219 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.037898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:52.037898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-05310789-9895-4ac9-90d0-38cc436417e2 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 404 len: 111 microversion: 2.1 time: 0.033047 Aug 08 18:15:52.037898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 485/937] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:51 2022] DELETE /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 18:15:52.042181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:52.042858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: 7ed37849-c0e9-4d24-a56d-ecdd9bce3532] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:52.049492 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:52.049971 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:52.050406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:52.051102 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:52.051556 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:52.051983 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:52.072576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 HTTP/1.1 Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:15:52.074220 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.076087 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '7ed37849-c0e9-4d24-a56d-ecdd9bce3532'} Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:52.081057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. Aug 08 18:15:52.082827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.084264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance 7ed37849-c0e9-4d24-a56d-ecdd9bce3532 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:52.084264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1df9df88-019c-4522-a358-d660f1b3cac5 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532" status: 404 len: 111 microversion: 2.1 time: 0.037392 Aug 08 18:15:52.084264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 453/938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:52 2022] GET /compute/v2.1/servers/7ed37849-c0e9-4d24-a56d-ecdd9bce3532 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:52.339407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:52.339899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:52.345873 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:52.346352 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:52.346783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:52.347467 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:52.348032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:52.348452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:52.366167 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] HTTP exception thrown: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Request method failure captured: Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 HTTP/1.1 Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFB2aP0d-tmHv9AIMpSDq23E4e3i0ZCrnrXcvNeD4l9XlxeB2npYYpGrr62VxEXJePllCtUF3dOhlaPMwIrKXCwxCdJee6oSJ8GqDZBNbKAvUjMjmJJpmo7DdEJzF1JeD7022Lp2FPU6O3lb8lkGX6gpdXkXzE8WQS5KQ3q0i9Tjdk Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:15:52.367712 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5de58eb192de494b809a04e638e2a291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5de58eb192de494b809a04e638e2a291", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: caf8d88ca4da4515bd9f1bec64da3375 Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.369164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '2d934484-9583-4162-bd95-ff93c9ff9372'} Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:52.370448 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.372383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.375945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Returning 404 to user: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:52.375945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-adad4be8-60a2-4c75-a51e-0af668975291 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 404 len: 111 microversion: 2.1 time: 0.033666 Aug 08 18:15:52.375945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 486/939] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:52 2022] DELETE /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:52.381409 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:52.382102 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] [instance: 2d934484-9583-4162-bd95-ff93c9ff9372] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:52.388160 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:52.388685 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:52.389677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:52.389924 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:52.390572 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:52.390995 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:52.418411 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] HTTP exception thrown: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Request method failure captured: Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 HTTP/1.1 Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VFB2aP0d-tmHv9AIMpSDq23E4e3i0ZCrnrXcvNeD4l9XlxeB2npYYpGrr62VxEXJePllCtUF3dOhlaPMwIrKXCwxCdJee6oSJ8GqDZBNbKAvUjMjmJJpmo7DdEJzF1JeD7022Lp2FPU6O3lb8lkGX6gpdXkXzE8WQS5KQ3q0i9Tjdk Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:15:52.419982 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5de58eb192de494b809a04e638e2a291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5de58eb192de494b809a04e638e2a291", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5de58eb192de494b809a04e638e2a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 5de58eb192de494b809a04e638e2a291 Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-304301420 Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: caf8d88ca4da4515bd9f1bec64da3375 Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeTestJSON-304301420-project Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.422244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '2d934484-9583-4162-bd95-ff93c9ff9372'} Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:52.423154 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. Aug 08 18:15:52.424664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:52.425985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] Returning 404 to user: Instance 2d934484-9583-4162-bd95-ff93c9ff9372 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:52.425985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1efe14c5-5990-41b3-9094-e0ab3ef24601 tempest-AttachVolumeTestJSON-304301420 tempest-AttachVolumeTestJSON-304301420-project] 10.222.0.50 "GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372" status: 404 len: 111 microversion: 2.1 time: 0.044391 Aug 08 18:15:52.425985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 454/940] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:52 2022] GET /compute/v2.1/servers/2d934484-9583-4162-bd95-ff93c9ff9372 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:53.449324 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:53.449866 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:53.457236 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:53.457721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:53.458157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:53.458849 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:53.459301 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:53.459728 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:53.477597 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d HTTP/1.1 Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:15:53.479371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.484806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'f14da550-cc04-4944-ab43-06c1599eb76d'} Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:53.485822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.487275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.488798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:53.488798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b12b6539-1a67-4c7a-8320-7d03e3960745 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 404 len: 111 microversion: 2.1 time: 0.035418 Aug 08 18:15:53.488798 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 487/941] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:53 2022] DELETE /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:53.490104 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:53.490725 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: f14da550-cc04-4944-ab43-06c1599eb76d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:53.497920 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:53.498411 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:53.499343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:53.500251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:53.500745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:53.501194 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:53.517632 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d HTTP/1.1 Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:15:53.519290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.520867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': 'f14da550-cc04-4944-ab43-06c1599eb76d'} Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:53.521911 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. Aug 08 18:15:53.523290 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.524565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance f14da550-cc04-4944-ab43-06c1599eb76d could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:53.524565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dd9c163a-ea37-4f32-a261-8baa9e4e59d0 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d" status: 404 len: 111 microversion: 2.1 time: 0.034345 Aug 08 18:15:53.524565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 455/942] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:53 2022] GET /compute/v2.1/servers/f14da550-cc04-4944-ab43-06c1599eb76d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:53.529271 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:53.529918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:53.535886 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:53.536359 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:53.536890 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:53.537594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:53.538060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:53.538492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:53.552941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 HTTP/1.1 Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:15:53.554536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.558493 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'cb281727-027c-4c38-99bb-09d9d1997425'} Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:53.559548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.561622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.563538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:53.563538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4f2d2d60-51fc-4494-8777-1a70fca2cffa tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 404 len: 111 microversion: 2.1 time: 0.030558 Aug 08 18:15:53.563538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 488/943] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:53 2022] DELETE /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:53.567217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:53.567843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: cb281727-027c-4c38-99bb-09d9d1997425] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:53.574034 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:53.574520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:53.574960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:53.575725 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:53.576192 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:53.581659 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:53.600178 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 HTTP/1.1 Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:15:53.601673 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.603365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': 'cb281727-027c-4c38-99bb-09d9d1997425'} Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:53.604214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. Aug 08 18:15:53.605549 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:53.606682 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance cb281727-027c-4c38-99bb-09d9d1997425 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:53.606682 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-82d3638c-ccde-425b-8262-dc63c9d8bcd6 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425" status: 404 len: 111 microversion: 2.1 time: 0.039747 Aug 08 18:15:53.606682 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 456/944] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:53 2022] GET /compute/v2.1/servers/cb281727-027c-4c38-99bb-09d9d1997425 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:54.890131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:54.890634 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:54.897536 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:54.898013 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:54.898499 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:54.899940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:54.900235 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:54.900727 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:54.918700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 HTTP/1.1 Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:15:54.920556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.922135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'db7f0620-836d-4a7c-839b-4e8b4a731735'} Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:54.923038 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.924521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.927266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:54.928312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9379e333-2e91-4b67-8888-10870492e511 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "DELETE /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 404 len: 111 microversion: 2.1 time: 0.042560 Aug 08 18:15:54.929042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 489/945] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:15:54 2022] DELETE /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:15:54.938058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:15:54.938823 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] [instance: db7f0620-836d-4a7c-839b-4e8b4a731735] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:15:54.948992 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:54.949801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:54.952042 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:54.952042 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:15:54.952042 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:15:54.953073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:15:54.968599 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] HTTP exception thrown: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Request method failure captured: Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 HTTP/1.1 Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VE9pHBP3GIUhrOxzyl8BX5GQjI0mJ5vW3utwPdzNqHckyqjNUBgvnrLljTGnv6y6SNwgNZkbPK5bNwqEvtELekicraotNGRPdQdH6_uITlguUlEQwOFCNUH-FWx273tVH-y-4JXH5yyoJPZLKqwuHnEqo76uhhCOMcaOPSlGdN0pcE Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:15:54.970168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c0061f213bfd4e3b87a0582b6cec6487", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c0061f213bfd4e3b87a0582b6cec6487"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c0061f213bfd4e3b87a0582b6cec6487 Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-935519547 Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2d5e7d5c77084705b1f39406293ab585 Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-935519547-project Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.972062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': 'db7f0620-836d-4a7c-839b-4e8b4a731735'} Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:15:54.977148 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. Aug 08 18:15:54.978759 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:15:54.980055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] Returning 404 to user: Instance db7f0620-836d-4a7c-839b-4e8b4a731735 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:15:54.980055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4b5f9def-3223-477b-8da6-240c874f3274 tempest-AttachVolumeNegativeTest-935519547 tempest-AttachVolumeNegativeTest-935519547-project] 10.222.0.50 "GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735" status: 404 len: 111 microversion: 2.1 time: 0.038644 Aug 08 18:15:54.980055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 457/946] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:15:54 2022] GET /compute/v2.1/servers/db7f0620-836d-4a7c-839b-4e8b4a731735 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:16:04.408556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-be355167-dd73-4334-9c42-9a24c5fb0f7b tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21adaf1ca0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:04.472212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-be355167-dd73-4334-9c42-9a24c5fb0f7b tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/81f06db9-05ef-439d-8166-8992a8dbe116" status: 200 len: 350 microversion: 2.1 time: 0.069955 Aug 08 18:16:04.472829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 490/947] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:16:04 2022] GET /compute/v2.1/os-volumes/81f06db9-05ef-439d-8166-8992a8dbe116 => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:16:06.134554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:06.135054 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:06.148203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:06.154563 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=47 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:06.154563 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:06.154563 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:06.156772 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=17 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:06.158054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=77 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:06.162555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-0cf12b82-649a-4917-8a68-7f85bc166b16 req-fcce5f23-4f47-4d26-b332-3a1a07d38d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d", "tag": "ba2a15cb-dff8-4775-9544-c1155b4411cf"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:06.169970 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:06.170907 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:06.171407 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:06.171850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:06.189191 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0cf12b82-649a-4917-8a68-7f85bc166b16 req-fcce5f23-4f47-4d26-b332-3a1a07d38d60 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:06.191787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0cf12b82-649a-4917-8a68-7f85bc166b16 req-fcce5f23-4f47-4d26-b332-3a1a07d38d60 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:06.193963 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-0cf12b82-649a-4917-8a68-7f85bc166b16 req-fcce5f23-4f47-4d26-b332-3a1a07d38d60 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:06.222516 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-0cf12b82-649a-4917-8a68-7f85bc166b16 req-fcce5f23-4f47-4d26-b332-3a1a07d38d60 service nova] Creating event network-changed:ba2a15cb-dff8-4775-9544-c1155b4411cf for instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d on hv-cinder-85236 Aug 08 18:16:06.233541 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-0cf12b82-649a-4917-8a68-7f85bc166b16 req-fcce5f23-4f47-4d26-b332-3a1a07d38d60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077286 Aug 08 18:16:06.237492 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 491/948] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:16:06.238351 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:16:06.394445 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-336e377d-1de1-45f1-b836-05162176ed20 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21ac6794c0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:06.522725 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-336e377d-1de1-45f1-b836-05162176ed20 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/46f83331-bf14-44f3-8276-095f2882ab0c" status: 200 len: 350 microversion: 2.1 time: 0.132092 Aug 08 18:16:06.523309 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 492/949] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:16:06 2022] GET /compute/v2.1/os-volumes/46f83331-bf14-44f3-8276-095f2882ab0c => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:06.841198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c19a9d19-a1c3-4f5b-aebf-92fdd66d265f tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 204 len: 0 microversion: 2.1 time: 0.711376 Aug 08 18:16:06.842025 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 458/950] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:16:06 2022] DELETE /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:16:06.852720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:06.852720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:06.864901 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:06.865655 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:06.867998 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:06.868963 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:06.871496 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:06.872150 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:07.198781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:07.223013 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-94f9a21c-6427-43ca-bad1-18729c287df4 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.373563 Aug 08 18:16:07.237822 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 493/951] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:06 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:08.263949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:08.268967 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:08.283910 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:08.284611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:08.284925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:08.285685 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:08.286144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:08.289108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:08.494682 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e21baa73-d615-4ac6-a1e2-fdc60ee8458e tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21ac7e7280>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:08.584168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e21baa73-d615-4ac6-a1e2-fdc60ee8458e tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/36515ea2-e987-4dd2-a19b-f86fab4e524c" status: 200 len: 350 microversion: 2.1 time: 0.087541 Aug 08 18:16:08.584168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 494/952] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:16:08 2022] GET /compute/v2.1/os-volumes/36515ea2-e987-4dd2-a19b-f86fab4e524c => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:08.592343 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-169d2a44-42c7-4a1c-b89f-1eab238616ff tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21ac7c4f70>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:08.831202 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-169d2a44-42c7-4a1c-b89f-1eab238616ff tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.243190 Aug 08 18:16:08.831995 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 495/953] 10.222.0.50 () {58 vars in 1134 bytes} [Mon Aug 8 18:16:08 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:16:08.848667 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-61cf47c7-7010-4dc7-a1a4-d785b0327d2f tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21ac664790>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:08.876356 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:08.895538 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-45e0b4a7-0ef7-433b-b850-40673b702195 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1568 microversion: 2.1 time: 0.637454 Aug 08 18:16:08.896119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 459/954] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:08 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1568 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:09.003885 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-61cf47c7-7010-4dc7-a1a4-d785b0327d2f tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.159725 Aug 08 18:16:09.028067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 496/955] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Aug 8 18:16:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:09.030688 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-61b4e7ab-6d70-4050-878a-986bb5574849 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21acdfee50>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:09.153015 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-61b4e7ab-6d70-4050-878a-986bb5574849 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.126386 Aug 08 18:16:09.153015 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 460/956] 10.222.0.50 () {58 vars in 1134 bytes} [Mon Aug 8 18:16:09 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:09.164457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-17c46da2-2cbe-4a5c-8e6a-33e8878e2050 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21ac664700>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:09.263379 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-17c46da2-2cbe-4a5c-8e6a-33e8878e2050 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102172 Aug 08 18:16:09.266971 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 497/957] 10.222.0.50 () {58 vars in 1167 bytes} [Mon Aug 8 18:16:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:09.282111 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a25efec1-ead5-4d26-9303-82e1dd55d004 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21acdd6430>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:09.458744 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a25efec1-ead5-4d26-9303-82e1dd55d004 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.180949 Aug 08 18:16:09.473095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 461/958] 10.222.0.50 () {58 vars in 1170 bytes} [Mon Aug 8 18:16:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:09.474278 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cfc4ad03-4a38-4b55-af15-ea0bafe76eb3 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21ac7e7dc0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:09.569394 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cfc4ad03-4a38-4b55-af15-ea0bafe76eb3 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.099313 Aug 08 18:16:09.570225 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 498/959] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Aug 8 18:16:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:16:09.585233 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-76ae95c6-dce0-41e1-8d64-0537229a0d91 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21acdd68b0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:09.735423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-76ae95c6-dce0-41e1-8d64-0537229a0d91 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.135428 Aug 08 18:16:09.735423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 462/960] 10.222.0.50 () {58 vars in 1188 bytes} [Mon Aug 8 18:16:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:09.735617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-a2b25947-d628-4342-b9db-80e746426ef6 req-d8460885-7a80-44b1-bce0-2bf9d265f720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d", "name": "network-vif-deleted", "tag": "ba2a15cb-dff8-4775-9544-c1155b4411cf"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:09.747155 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ed13b5d5-1ca5-45ab-9891-59e43f768844 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] Calling method '.version_select at 0x7f21ace6d0d0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:09.756311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-a2b25947-d628-4342-b9db-80e746426ef6 req-d8460885-7a80-44b1-bce0-2bf9d265f720 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:09.756823 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-a2b25947-d628-4342-b9db-80e746426ef6 req-d8460885-7a80-44b1-bce0-2bf9d265f720 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:09.757248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-a2b25947-d628-4342-b9db-80e746426ef6 req-d8460885-7a80-44b1-bce0-2bf9d265f720 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:09.773898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-a2b25947-d628-4342-b9db-80e746426ef6 req-d8460885-7a80-44b1-bce0-2bf9d265f720 service nova] Creating event network-vif-deleted:ba2a15cb-dff8-4775-9544-c1155b4411cf for instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d on hv-cinder-85236 Aug 08 18:16:09.779065 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-a2b25947-d628-4342-b9db-80e746426ef6 req-d8460885-7a80-44b1-bce0-2bf9d265f720 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052339 Aug 08 18:16:09.780695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 499/961] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:09.846343 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ed13b5d5-1ca5-45ab-9891-59e43f768844 tempest-VolumesTestJSON-1579221990 tempest-VolumesTestJSON-1579221990-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.103045 Aug 08 18:16:09.852920 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 463/962] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Aug 8 18:16:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:09.923004 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:09.923714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:09.950130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:09.950130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:09.950130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:09.950130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:09.950671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:09.950671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:10.057084 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:10.072128 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5d53857f-f79c-436e-97e3-efa78c81de76 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1218 microversion: 2.1 time: 0.152925 Aug 08 18:16:10.073378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 500/963] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:09 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:11.095258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:11.095866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:11.102582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:11.103310 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:11.104116 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:11.104923 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:11.112246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:11.112246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:11.160894 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:11.161776 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:11.162324 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:11.162845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lazy-loading 'fault' on Instance uuid bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:16:11.268686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d7f6721a3a40f380578391949c443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64273458329d44edb0e2904b4011b591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:11.284866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b0cd76d7-8a83-4a8b-babc-883c38925a14 tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 200 len: 1223 microversion: 2.1 time: 0.191977 Aug 08 18:16:11.286007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 464/964] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:11 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 1223 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:16:12.128650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f7596f87-54c8-4779-ae2e-4ec257cb1853 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Action: 'create', calling method: .version_select at 0x7f21ac8195e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-605769720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPT+dOPFdBcDTw1TJfGk7R9lWR4ZXzqjZgbtFdySM13YhssKeoK3hqktMEIaLjrBp1TXTR93H09AYbnAihkkv4+ZWzjnGduemy9XgCOhV1P+gC0bmibKy2dn4N6MvuEyng=="}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:12.143058 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-f7596f87-54c8-4779-ae2e-4ec257cb1853 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Getting quotas for project c98de54846de4169b0ea5cca7aae3cf0. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:16:12.147186 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-f7596f87-54c8-4779-ae2e-4ec257cb1853 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Getting quotas for user 0c911d938fd64f25844903809d56b263 and project c98de54846de4169b0ea5cca7aae3cf0. Resources: {'key_pairs'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:16:12.234156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f7596f87-54c8-4779-ae2e-4ec257cb1853 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.306036 Aug 08 18:16:12.234874 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 501/965] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Aug 8 18:16:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:12.237226 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:12.239968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:12.247050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:12.247536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:12.247968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:12.253635 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:12.254321 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:12.254936 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:12.287420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a75656c4-6c43-4f74-a2f4-c761e4a3f5de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054317 Aug 08 18:16:12.287981 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 465/966] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Aug 8 18:16:12 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:16:12.306405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:12.307212 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] [instance: bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:12.317003 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:12.318157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:12.318744 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:12.319630 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:12.320074 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:12.320495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:12.336622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] HTTP exception thrown: Instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d could not be found. Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Request method failure captured: Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d HTTP/1.1 Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VGNtqVYDvS3Sc3TeO3ZgK9Rj0hi8gM922IGo-o6F07-8OtNmhyg6bgYCIugMStcX8UfIzMQGVBz-E-lQ-FkcfvqQWivuG6I8EDfzJnyTwTWD3yrBS4ApDVJjy0-w8A1-fbf78C-yLm-ya0wcTw0gwHWsHgIWXacpMvvJoPIU2nvAqw Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 64273458329d44edb0e2904b4011b591 Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-TestShelveInstance-1879735703 Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:16:12.342860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/64273458329d44edb0e2904b4011b591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_64273458329d44edb0e2904b4011b591", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/64273458329d44edb0e2904b4011b591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/64273458329d44edb0e2904b4011b591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-TestShelveInstance-1879735703 Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 64273458329d44edb0e2904b4011b591 Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-TestShelveInstance-1879735703 Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-TestShelveInstance-1879735703-project Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: b7d7f6721a3a40f380578391949c443b Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-TestShelveInstance-1879735703-project Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d could not be found. Aug 08 18:16:12.344549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d'} Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d could not be found. Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:12.345361 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d could not be found. Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d could not be found. Aug 08 18:16:12.346722 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:12.347880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Returning 404 to user: Instance bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:12.347880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-190ede0b-22a9-42c2-9fbf-0a701e3af34b tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d" status: 404 len: 111 microversion: 2.1 time: 0.042927 Aug 08 18:16:12.347880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 502/967] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:12 2022] GET /compute/v2.1/servers/bab77e1f-1c1d-441e-8e6b-1fb23fbc5f6d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:16:12.358320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:12.359354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:12.374657 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:12.377884 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:12.379562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:12.383161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:12.383308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:12.383748 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:12.414576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:16:12.655639 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-34e8b590-bf48-4d69-a83f-e1f85b6fb10d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] Calling method '.version_select at 0x7f21ac664e50>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:12.704791 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d10c969e-720e-472e-979d-c603b64e89a5 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 204 len: 0 microversion: 2.20 time: 0.351602 Aug 08 18:16:12.711048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 466/968] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Aug 8 18:16:12 2022] DELETE /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 18:16:12.714420 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:12.715123 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:12.721156 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:12.721647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:12.722146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:12.722791 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:12.723251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:12.723676 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:12.740631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-34e8b590-bf48-4d69-a83f-e1f85b6fb10d tempest-TestShelveInstance-1879735703 tempest-TestShelveInstance-1879735703-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-143660103" status: 202 len: 0 microversion: 2.1 time: 0.089293 Aug 08 18:16:12.741154 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 503/969] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Aug 8 18:16:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-143660103 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 18:16:12.883799 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:12.892900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:12.894476 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:12.895652 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7f544cf1-4f8e-491c-bc56-1f155db35510 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.185563 Aug 08 18:16:12.896203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 467/970] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:16:12 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 18:16:13.919918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:13.921747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:13.928403 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:13.928914 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:13.929354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:13.930046 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:13.930508 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:13.930932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:14.113429 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:14.125904 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:14.131950 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:14.131950 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b000e08e-6cb8-4fb7-a898-d13ab593b7b8 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.213805 Aug 08 18:16:14.131950 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 504/971] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:16:13 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:16:15.168195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:15.172228 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:15.188555 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:15.190365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:15.192951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:15.193833 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:15.195012 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:15.198112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:15.607229 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:15.651057 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:15.657084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:15.658345 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a4198839-64fb-4479-a011-563aa1a9db6b tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1723 microversion: 2.20 time: 0.508188 Aug 08 18:16:15.685328 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 468/972] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:16:15 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:16:16.187870 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-201f4f55-2690-4b81-be85-ab06b01fbafd req-05435d56-3dd1-47c5-b312-77a1d502fb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce432ca-7675-48f3-96a4-55aebc18503d", "name": "network-vif-deleted", "tag": "7cc61064-033f-47bf-8688-67f7559828a2"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:16.234397 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-201f4f55-2690-4b81-be85-ab06b01fbafd req-05435d56-3dd1-47c5-b312-77a1d502fb92 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:16.238426 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-201f4f55-2690-4b81-be85-ab06b01fbafd req-05435d56-3dd1-47c5-b312-77a1d502fb92 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:16.238924 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-201f4f55-2690-4b81-be85-ab06b01fbafd req-05435d56-3dd1-47c5-b312-77a1d502fb92 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:16.268151 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-201f4f55-2690-4b81-be85-ab06b01fbafd req-05435d56-3dd1-47c5-b312-77a1d502fb92 service nova] Creating event network-vif-deleted:7cc61064-033f-47bf-8688-67f7559828a2 for instance 5ce432ca-7675-48f3-96a4-55aebc18503d on hv-cinder-85236 Aug 08 18:16:16.278137 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-201f4f55-2690-4b81-be85-ab06b01fbafd req-05435d56-3dd1-47c5-b312-77a1d502fb92 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094370 Aug 08 18:16:16.280690 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 505/973] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:16:16.688786 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:16.692122 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:16.703439 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:16.704125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:16.704764 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:16.705742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:16.706195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:16.706786 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:16.773819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:16.776562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:16.777793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:16.778421 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lazy-loading 'fault' on Instance uuid 5ce432ca-7675-48f3-96a4-55aebc18503d {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:16:16.843714 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:16.868744 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:16.877923 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ec53f935a6c41f2af67e9fd2e13e12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf197791c8734703b20784498cd8dcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:16.884839 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-923db3a7-3b29-4b13-a715-3a19947a76bd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 200 len: 1371 microversion: 2.20 time: 0.199466 Aug 08 18:16:16.885554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 469/974] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:16:16 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 18:16:17.917738 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:17.918507 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:17.930106 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:17.930600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:17.931036 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:17.938540 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:17.939039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:17.939485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:17.975543 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] HTTP exception thrown: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Request method failure captured: Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d HTTP/1.1 Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFEzX6MiZ2KM-AwQaXPHdD3kamzNfdhJ4oizldk4bcvl9c57wWkdtmepNHMvHGTgf_dqbNNQEgIaaMxPJ49SzUcrnil7hZyG5bAZGVEAw-Gi9WutCBbSPVf9-gel3_GSDt-4lO4SHPYoFCKBIEyn3kMlIk0FYrMKqEw23vfEndXA0E Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:16:17.977288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf197791c8734703b20784498cd8dcd5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2ec53f935a6c41f2af67e9fd2e13e12c Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:17.979118 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '5ce432ca-7675-48f3-96a4-55aebc18503d'} Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:17.979884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:17.981145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:17.982380 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Returning 404 to user: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:17.982380 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7ea3d7a9-fc51-46f7-a3fd-60d77fa953de tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 404 len: 111 microversion: 2.20 time: 0.067938 Aug 08 18:16:18.008041 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-151d5d55-1d36-48e1-9393-116c56133bdd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '.version_select at 0x7f21ace56c10>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:18.014556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 506/975] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:16:17 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 18:16:18.118674 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-151d5d55-1d36-48e1-9393-116c56133bdd tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-874715701" status: 204 len: 0 microversion: 2.20 time: 0.130663 Aug 08 18:16:18.123051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 470/976] 10.222.0.50 () {60 vars in 1259 bytes} [Mon Aug 8 18:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-874715701 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 18:16:21.068986 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:21.071199 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:21.084105 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:21.086929 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:21.087631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:21.088720 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:21.089535 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:21.090143 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:21.123141 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] HTTP exception thrown: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Request method failure captured: Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d HTTP/1.1 Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFEzX6MiZ2KM-AwQaXPHdD3kamzNfdhJ4oizldk4bcvl9c57wWkdtmepNHMvHGTgf_dqbNNQEgIaaMxPJ49SzUcrnil7hZyG5bAZGVEAw-Gi9WutCBbSPVf9-gel3_GSDt-4lO4SHPYoFCKBIEyn3kMlIk0FYrMKqEw23vfEndXA0E Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:16:21.126521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf197791c8734703b20784498cd8dcd5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2ec53f935a6c41f2af67e9fd2e13e12c Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.128419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '5ce432ca-7675-48f3-96a4-55aebc18503d'} Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:21.129388 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.133080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.135466 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Returning 404 to user: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:21.136747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a0dd0a83-b647-478d-9e8f-1cdf6006e2ff tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 404 len: 111 microversion: 2.20 time: 0.073753 Aug 08 18:16:21.137791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 507/977] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Aug 8 18:16:21 2022] DELETE /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 18:16:21.159462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:21.159462 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 5ce432ca-7675-48f3-96a4-55aebc18503d] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:21.170829 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:21.171478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:21.172004 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:21.172958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:21.173491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:21.173996 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:21.189536 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] HTTP exception thrown: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Request method failure captured: Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d HTTP/1.1 Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VFEzX6MiZ2KM-AwQaXPHdD3kamzNfdhJ4oizldk4bcvl9c57wWkdtmepNHMvHGTgf_dqbNNQEgIaaMxPJ49SzUcrnil7hZyG5bAZGVEAw-Gi9WutCBbSPVf9-gel3_GSDt-4lO4SHPYoFCKBIEyn3kMlIk0FYrMKqEw23vfEndXA0E Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:16:21.190925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf197791c8734703b20784498cd8dcd5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2ec53f935a6c41f2af67e9fd2e13e12c Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.192370 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '5ce432ca-7675-48f3-96a4-55aebc18503d'} Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:21.194315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. Aug 08 18:16:21.195554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:21.196743 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Returning 404 to user: Instance 5ce432ca-7675-48f3-96a4-55aebc18503d could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:21.196743 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b2d5292a-95f7-4f2b-8576-c14cb5b98534 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d" status: 404 len: 111 microversion: 2.20 time: 0.047255 Aug 08 18:16:21.197636 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 471/978] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:16:21 2022] GET /compute/v2.1/servers/5ce432ca-7675-48f3-96a4-55aebc18503d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 18:16:22.599140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:22.599652 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:22.603355 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=4 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:22.610059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:22.610879 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:22.611484 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:22.612367 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:22.613016 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:22.613607 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:22.631325 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] HTTP exception thrown: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Request method failure captured: Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 HTTP/1.1 Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VFEzX6MiZ2KM-AwQaXPHdD3kamzNfdhJ4oizldk4bcvl9c57wWkdtmepNHMvHGTgf_dqbNNQEgIaaMxPJ49SzUcrnil7hZyG5bAZGVEAw-Gi9WutCBbSPVf9-gel3_GSDt-4lO4SHPYoFCKBIEyn3kMlIk0FYrMKqEw23vfEndXA0E Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:16:22.633040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf197791c8734703b20784498cd8dcd5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 2ec53f935a6c41f2af67e9fd2e13e12c Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.634495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '87c18185-5443-4967-832b-8cec6d6aa044'} Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:22.635276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.636572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.639658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Returning 404 to user: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:22.639658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4b77cce2-32be-4e1f-be82-2bebb15d1f14 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 404 len: 111 microversion: 2.20 time: 0.039585 Aug 08 18:16:22.639658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 508/979] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Aug 8 18:16:22 2022] DELETE /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 18:16:22.643018 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:22.654153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] [instance: 87c18185-5443-4967-832b-8cec6d6aa044] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:22.654153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:22.654153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:22.654153 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:22.654511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:22.654511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:22.654511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:22.667569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] HTTP exception thrown: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Request method failure captured: Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 HTTP/1.1 Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VFEzX6MiZ2KM-AwQaXPHdD3kamzNfdhJ4oizldk4bcvl9c57wWkdtmepNHMvHGTgf_dqbNNQEgIaaMxPJ49SzUcrnil7hZyG5bAZGVEAw-Gi9WutCBbSPVf9-gel3_GSDt-4lO4SHPYoFCKBIEyn3kMlIk0FYrMKqEw23vfEndXA0E Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:16:22.669814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf197791c8734703b20784498cd8dcd5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf197791c8734703b20784498cd8dcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: cf197791c8734703b20784498cd8dcd5 Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2040095331 Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 2ec53f935a6c41f2af67e9fd2e13e12c Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2040095331-project Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.671885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '87c18185-5443-4967-832b-8cec6d6aa044'} Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:22.672765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. Aug 08 18:16:22.674045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:22.676645 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] Returning 404 to user: Instance 87c18185-5443-4967-832b-8cec6d6aa044 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:22.677692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1dcbb273-1ad7-453e-853c-752850dd31d7 tempest-AttachVolumeShelveTestJSON-2040095331 tempest-AttachVolumeShelveTestJSON-2040095331-project] 10.222.0.50 "GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044" status: 404 len: 111 microversion: 2.20 time: 0.038711 Aug 08 18:16:22.678751 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 472/980] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Aug 8 18:16:22 2022] GET /compute/v2.1/servers/87c18185-5443-4967-832b-8cec6d6aa044 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 18:16:28.923588 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b16aec0e-3f2a-42ab-8305-4df62b1efe65 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Action: 'create', calling method: .version_select at 0x7f21ac664c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1064730532", "metadata": {"Type": "work"}}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b16aec0e-3f2a-42ab-8305-4df62b1efe65 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Request method failure captured: Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 122 Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VL8YCmYcbd70vz068p5InaUv425XSHotXjnNJVd_kavaiXyY61ExVxOEAhB2G437gXIzP9RdK11Qs0Tkb86FLy-YJV6WUz8FrMObrnYoam6_Xe2mEEQvXObhI8EM_kIdM3FX9Nj5Tc8vqHCt2T3fvglV8M_W6weUq3AFa6QaAGMhOg Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:16:28.942628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_260afaf425fe4faf980b4e66806c7016", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 220214173b5d4c5cac74e256a4b3a549 Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1064730532", "metadata": {"Type": "work"}}} Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: Aug 08 18:16:28.944293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1064730532', 'metadata': {'Type': 'work'}}}} Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise error Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:28.945273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 18:16:28.946669 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 18:16:28.947830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 18:16:28.947830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.947830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b16aec0e-3f2a-42ab-8305-4df62b1efe65 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:28.947830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b16aec0e-3f2a-42ab-8305-4df62b1efe65 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.140774 Aug 08 18:16:28.947830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 509/981] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Aug 8 18:16:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 18:16:28.954682 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-691d7511-13fb-4bac-9861-8f4307e6c03c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Action: 'create', calling method: .version_select at 0x7f21ace56040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-619130409", "metadata": {"Type": "work"}}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-691d7511-13fb-4bac-9861-8f4307e6c03c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Request method failure captured: Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 119 Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VL8YCmYcbd70vz068p5InaUv425XSHotXjnNJVd_kavaiXyY61ExVxOEAhB2G437gXIzP9RdK11Qs0Tkb86FLy-YJV6WUz8FrMObrnYoam6_Xe2mEEQvXObhI8EM_kIdM3FX9Nj5Tc8vqHCt2T3fvglV8M_W6weUq3AFa6QaAGMhOg Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:16:28.959906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_260afaf425fe4faf980b4e66806c7016", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 220214173b5d4c5cac74e256a4b3a549 Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-619130409", "metadata": {"Type": "work"}}} Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: Aug 08 18:16:28.964805 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-619130409', 'metadata': {'Type': 'work'}}}} Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise error Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi '0' Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:28.965806 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 18:16:28.967419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 18:16:28.968893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 18:16:28.968893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.968893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-691d7511-13fb-4bac-9861-8f4307e6c03c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:28.968893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-691d7511-13fb-4bac-9861-8f4307e6c03c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011234 Aug 08 18:16:28.968893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 473/982] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Aug 8 18:16:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 18:16:28.972308 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ffc42e97-4ca0-4123-ba33-26c59242d0f0 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Action: 'create', calling method: .version_select at 0x7f21ac7e7c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-829098710", "metadata": {"Type": "work"}}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ffc42e97-4ca0-4123-ba33-26c59242d0f0 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Request method failure captured: Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 118 Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VL8YCmYcbd70vz068p5InaUv425XSHotXjnNJVd_kavaiXyY61ExVxOEAhB2G437gXIzP9RdK11Qs0Tkb86FLy-YJV6WUz8FrMObrnYoam6_Xe2mEEQvXObhI8EM_kIdM3FX9Nj5Tc8vqHCt2T3fvglV8M_W6weUq3AFa6QaAGMhOg Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:16:28.976946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_260afaf425fe4faf980b4e66806c7016", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 220214173b5d4c5cac74e256a4b3a549 Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-829098710", "metadata": {"Type": "work"}}} Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: Aug 08 18:16:28.978596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-829098710', 'metadata': {'Type': 'work'}}}} Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise error Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi '' Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:28.979603 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 18:16:28.981311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 18:16:28.982491 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 18:16:28.982491 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:28.982491 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ffc42e97-4ca0-4123-ba33-26c59242d0f0 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:28.982491 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ffc42e97-4ca0-4123-ba33-26c59242d0f0 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010556 Aug 08 18:16:28.982491 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 510/983] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Aug 8 18:16:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 18:16:28.988150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9ad05e9c-91ea-49da-aff3-b678de273766 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Calling method '.version_select at 0x7f21acd68700>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:29.017377 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-9ad05e9c-91ea-49da-aff3-b678de273766 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] HTTP exception thrown: Volume tempest-invalid-542322241 could not be found. Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9ad05e9c-91ea-49da-aff3-b678de273766 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Request method failure captured: Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-542322241 HTTP/1.1 Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VL8YCmYcbd70vz068p5InaUv425XSHotXjnNJVd_kavaiXyY61ExVxOEAhB2G437gXIzP9RdK11Qs0Tkb86FLy-YJV6WUz8FrMObrnYoam6_Xe2mEEQvXObhI8EM_kIdM3FX9Nj5Tc8vqHCt2T3fvglV8M_W6weUq3AFa6QaAGMhOg Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:16:29.019513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_260afaf425fe4faf980b4e66806c7016", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 220214173b5d4c5cac74e256a4b3a549 Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Volume tempest-invalid-542322241 could not be found. Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': 'tempest-invalid-542322241'} Aug 08 18:16:29.021144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-542322241 could not be found. (HTTP 404) (Request-ID: req-97687578-7977-49dd-9741-f32a2ce81832) Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.022272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 18:16:29.023708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-542322241 could not be found. Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:29.025293 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-542322241 could not be found. Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-542322241 could not be found. Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9ad05e9c-91ea-49da-aff3-b678de273766 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Returning 404 to user: Volume tempest-invalid-542322241 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9ad05e9c-91ea-49da-aff3-b678de273766 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-542322241" status: 404 len: 98 microversion: 2.1 time: 0.037330 Aug 08 18:16:29.026800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 474/984] 10.222.0.50 () {58 vars in 1215 bytes} [Mon Aug 8 18:16:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-542322241 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 08 18:16:29.032457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7d262f72-80bf-4941-940d-aee6210198bf tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004241 Aug 08 18:16:29.032985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 511/985] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Aug 8 18:16:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 18:16:29.041206 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b3f5d1ee-2f53-42b8-b093-daaaaf7e0c66 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003731 Aug 08 18:16:29.041690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 475/986] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Aug 8 18:16:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 18:16:29.050195 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5913f1dc-4a02-4e76-a628-2ffcd6266705 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Calling method '.version_select at 0x7f21ac7960d0>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:29.080040 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-5913f1dc-4a02-4e76-a628-2ffcd6266705 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] HTTP exception thrown: Volume a5d91c14-83c1-4655-b0fa-2daa7a83e80d could not be found. Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5913f1dc-4a02-4e76-a628-2ffcd6266705 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Request method failure captured: Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/os-volumes/a5d91c14-83c1-4655-b0fa-2daa7a83e80d HTTP/1.1 Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VL8YCmYcbd70vz068p5InaUv425XSHotXjnNJVd_kavaiXyY61ExVxOEAhB2G437gXIzP9RdK11Qs0Tkb86FLy-YJV6WUz8FrMObrnYoam6_Xe2mEEQvXObhI8EM_kIdM3FX9Nj5Tc8vqHCt2T3fvglV8M_W6weUq3AFa6QaAGMhOg Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:16:29.083216 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_260afaf425fe4faf980b4e66806c7016", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 220214173b5d4c5cac74e256a4b3a549 Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Volume a5d91c14-83c1-4655-b0fa-2daa7a83e80d could not be found. Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': 'a5d91c14-83c1-4655-b0fa-2daa7a83e80d'} Aug 08 18:16:29.084916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5d91c14-83c1-4655-b0fa-2daa7a83e80d could not be found. (HTTP 404) (Request-ID: req-ea6a9ae7-3640-4c2d-bf79-6cff10ce7385) Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.085895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 18:16:29.087284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5d91c14-83c1-4655-b0fa-2daa7a83e80d could not be found. Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 18:16:29.088671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5d91c14-83c1-4655-b0fa-2daa7a83e80d could not be found. Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5d91c14-83c1-4655-b0fa-2daa7a83e80d could not be found. Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5913f1dc-4a02-4e76-a628-2ffcd6266705 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Returning 404 to user: Volume a5d91c14-83c1-4655-b0fa-2daa7a83e80d could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5913f1dc-4a02-4e76-a628-2ffcd6266705 tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/a5d91c14-83c1-4655-b0fa-2daa7a83e80d" status: 404 len: 109 microversion: 2.1 time: 0.038835 Aug 08 18:16:29.090051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 512/987] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Aug 8 18:16:29 2022] DELETE /compute/v2.1/os-volumes/a5d91c14-83c1-4655-b0fa-2daa7a83e80d => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:16:29.096207 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-168d33e1-cbb8-45fd-b977-498dd6881d5c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Calling method '.version_select at 0x7f21acdf99d0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-168d33e1-cbb8-45fd-b977-498dd6881d5c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] HTTP exception thrown: Volume 3afb38b2-bb46-4f64-a08f-9340703a0a64 could not be found. Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-168d33e1-cbb8-45fd-b977-498dd6881d5c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Request method failure captured: Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/os-volumes/3afb38b2-bb46-4f64-a08f-9340703a0a64 HTTP/1.1 Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VL8YCmYcbd70vz068p5InaUv425XSHotXjnNJVd_kavaiXyY61ExVxOEAhB2G437gXIzP9RdK11Qs0Tkb86FLy-YJV6WUz8FrMObrnYoam6_Xe2mEEQvXObhI8EM_kIdM3FX9Nj5Tc8vqHCt2T3fvglV8M_W6weUq3AFa6QaAGMhOg Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:16:29.135217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_260afaf425fe4faf980b4e66806c7016", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/260afaf425fe4faf980b4e66806c7016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 260afaf425fe4faf980b4e66806c7016 Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesNegativeTest-1463551247 Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 220214173b5d4c5cac74e256a4b3a549 Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesNegativeTest-1463551247-project Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Volume 3afb38b2-bb46-4f64-a08f-9340703a0a64 could not be found. Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '3afb38b2-bb46-4f64-a08f-9340703a0a64'} Aug 08 18:16:29.138485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3afb38b2-bb46-4f64-a08f-9340703a0a64 could not be found. (HTTP 404) (Request-ID: req-63bb1f83-98a2-4c75-a40c-9ef7848d3d08) Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.140171 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 18:16:29.143569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3afb38b2-bb46-4f64-a08f-9340703a0a64 could not be found. Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 18:16:29.146006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3afb38b2-bb46-4f64-a08f-9340703a0a64 could not be found. Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3afb38b2-bb46-4f64-a08f-9340703a0a64 could not be found. Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-168d33e1-cbb8-45fd-b977-498dd6881d5c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] Returning 404 to user: Volume 3afb38b2-bb46-4f64-a08f-9340703a0a64 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-168d33e1-cbb8-45fd-b977-498dd6881d5c tempest-VolumesNegativeTest-1463551247 tempest-VolumesNegativeTest-1463551247-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/3afb38b2-bb46-4f64-a08f-9340703a0a64" status: 404 len: 109 microversion: 2.1 time: 0.044755 Aug 08 18:16:29.147887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 476/988] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Aug 8 18:16:29 2022] GET /compute/v2.1/os-volumes/3afb38b2-bb46-4f64-a08f-9340703a0a64 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:16:42.012150 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:42.012953 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=32 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:42.017756 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-743389790", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-605769720", "security_groups": [{"name": "tempest-secgroup-smoke-679493763"}], "block_device_mapping_v2": [{"uuid": "fda60e56-e820-43df-a4a4-050e67bbca12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "977b81f6-64f9-443a-bb92-2dc33e37e639"}]}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:42.131513 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] validate_networks() for [('977b81f6-64f9-443a-bb92-2dc33e37e639', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:16:42.617194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:16:42.617642 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:16:42.618161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:16:42.618572 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:16:42.618989 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:16:42.627755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:42.628932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:42.629384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:42.630117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:42.630580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:42.631010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:42.648495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Getting quotas for project c98de54846de4169b0ea5cca7aae3cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:16:42.652704 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Getting quotas for user 0c911d938fd64f25844903809d56b263 and project c98de54846de4169b0ea5cca7aae3cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:16:42.712700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:16:42.714987 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fda60e56-e820-43df-a4a4-050e67bbca12',volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:16:43.175950 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4c2faf99-cdce-45fe-b307-2b0e01b6e2c5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.164323 Aug 08 18:16:43.176706 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 513/989] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:16:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:16:43.187703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:43.188718 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:43.193224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6d358e12-0bec-4346-8c11-ca39e3285432 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:43.201616 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6d358e12-0bec-4346-8c11-ca39e3285432 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:43.259603 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6d358e12-0bec-4346-8c11-ca39e3285432 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:43.266738 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6d358e12-0bec-4346-8c11-ca39e3285432 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1093 microversion: 2.1 time: 0.083257 Aug 08 18:16:43.267317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 477/990] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:43 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:44.287229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:44.287970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:44.297060 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:44.297548 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:44.298006 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:44.298732 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:44.299129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:44.299547 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:44.362755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:44.368763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-75784420-7254-46e4-8560-55b178f9acc8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1143 microversion: 2.1 time: 0.085493 Aug 08 18:16:44.369323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 514/991] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:44 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:45.390206 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:45.390930 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:45.399218 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:45.399826 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:45.400328 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:45.401121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:45.401644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:45.402073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:45.465501 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:45.474507 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5419e12a-df2e-4b67-8801-c91053ed94ca tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1143 microversion: 2.1 time: 0.088652 Aug 08 18:16:45.475075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 478/992] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:45 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:46.495133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:46.495747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:46.501946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:46.502428 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:46.502892 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:46.504082 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:46.504565 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:46.504991 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:46.571766 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:46.584092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-262534eb-8af7-46e1-8c98-0a690c29d2b3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1191 microversion: 2.1 time: 0.087799 Aug 08 18:16:46.584092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 515/993] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:46 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:47.608625 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:47.610625 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:47.620259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:47.621761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:47.621761 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:47.622756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:47.623396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:47.624003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:47.700085 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:47.707997 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3cdab5c5-e34b-45c5-8af5-d0f35357d33e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1209 microversion: 2.1 time: 0.104292 Aug 08 18:16:47.708576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 479/994] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:47 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:48.729498 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:48.729498 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:48.735837 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:48.736366 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:48.736873 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:48.737791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:48.738262 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:48.738786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:48.759780 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-d0177407-db42-4718-9437-113871b11164 req-71501b15-9aa5-461d-b491-d6ef315d75a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6363da42-8d2d-4e98-aabc-46fa6ca81bd7", "tag": "36e7c598-8df4-41e7-a656-c49754941c21"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:16:48.772732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d0177407-db42-4718-9437-113871b11164 req-71501b15-9aa5-461d-b491-d6ef315d75a6 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:48.774264 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d0177407-db42-4718-9437-113871b11164 req-71501b15-9aa5-461d-b491-d6ef315d75a6 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:48.774899 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d0177407-db42-4718-9437-113871b11164 req-71501b15-9aa5-461d-b491-d6ef315d75a6 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:48.786535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-d0177407-db42-4718-9437-113871b11164 req-71501b15-9aa5-461d-b491-d6ef315d75a6 service nova] Creating event network-changed:36e7c598-8df4-41e7-a656-c49754941c21 for instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 on hv-cinder-85236 Aug 08 18:16:48.792082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-d0177407-db42-4718-9437-113871b11164 req-71501b15-9aa5-461d-b491-d6ef315d75a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039906 Aug 08 18:16:48.792964 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 480/995] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:16:48.992005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:49.000678 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8a23f302-99c3-4948-b77d-04d5bd16ab24 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1276 microversion: 2.1 time: 0.275694 Aug 08 18:16:49.011909 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 516/996] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:48 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:50.022723 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:50.023427 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:50.029632 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:50.030112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:50.030547 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:50.031402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:50.031686 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:50.032225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:50.161009 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:50.168611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3b20183d-658f-438f-b752-3ab15fe388cd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.150481 Aug 08 18:16:50.169172 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 481/997] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:50 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:51.190057 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:51.190667 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:51.197857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:51.198351 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:51.198788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:51.199487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:51.199944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:51.200373 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:51.331210 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:51.338618 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-60e94c25-b372-4e10-ac9d-a10490e0736d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.152415 Aug 08 18:16:51.339214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 517/998] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:51 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:52.358692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:52.359266 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:52.366253 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:52.366740 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:52.367181 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:52.370067 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:52.370067 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:52.370067 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:52.501849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:52.509998 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cc10e9e3-874b-44af-86fb-a9a09b251c91 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.155498 Aug 08 18:16:52.510560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 482/999] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:52 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:53.531031 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:53.531594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:53.533883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:53.534533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=6 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:53.539244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:53.539729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:53.540157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:53.540967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:53.541503 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:53.541924 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:53.673974 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:53.681941 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9a5ae2a8-e560-441b-80f8-aa9161c064cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.154837 Aug 08 18:16:53.682517 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 518/1000] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:53 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:54.703213 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:54.703776 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:54.705848 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:16:54.711586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:54.712077 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:54.712586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:54.713242 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:54.713702 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:54.714137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:54.852457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:54.859928 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-54322ca7-c060-43d0-9033-28905f6799c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.160673 Aug 08 18:16:54.860491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 483/1001] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:54 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:55.881821 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:55.882437 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:55.888850 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:55.889332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:55.889765 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:55.890449 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:55.890901 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:55.891327 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:56.026622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:56.034017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-04dcf8dd-2db4-4e79-aa55-2db390fd6cfb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.156740 Aug 08 18:16:56.034593 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 519/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:55 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:57.054647 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:57.055272 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:57.061835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:57.062527 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:57.062975 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:57.063683 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:57.064144 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:57.064606 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:57.208847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:57.216717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-882637cf-5608-432f-af15-f2ca370b8fc3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.165665 Aug 08 18:16:57.217278 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 484/1003] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:57 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:58.237815 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:58.238422 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:58.244899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:58.245406 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:58.245834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:58.246571 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:58.247020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:58.247432 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:58.387832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:58.396238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9f5933b0-7134-4e38-a19f-e01250eb577b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.162481 Aug 08 18:16:58.396876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 520/1004] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:58 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:16:59.417610 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:16:59.418243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:16:59.424651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:59.425134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:59.425565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:59.426246 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:16:59.426695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:16:59.427113 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:16:59.563003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:16:59.570758 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-beb91c05-e962-4687-8cef-283f7d474534 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.157038 Aug 08 18:16:59.584702 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 485/1005] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:16:59 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:00.591485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:00.592097 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:00.615981 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:00.616477 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:00.616946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:00.617646 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:00.618100 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:00.618714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:00.830360 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:00.839371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-85481f59-820a-4198-99da-9bd8a1b6a8ba tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.251980 Aug 08 18:17:00.842341 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 521/1006] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:00 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:01.861634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:01.869243 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:01.869515 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:01.869812 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:01.870238 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:01.871118 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:01.871591 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:01.872014 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:02.042318 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:02.051965 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d2400c95-aefd-4b35-9a51-2de84fca30be tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.194599 Aug 08 18:17:02.052579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 486/1007] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:01 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:03.073389 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:03.074149 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:03.080751 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:03.081988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:03.082275 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:03.082967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:03.083419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:03.083954 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:03.223150 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:03.236327 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-5a6ebb65-95a8-4f0d-bdc3-469e2d544db9 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.166718 Aug 08 18:17:03.236984 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 522/1008] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:03 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:04.195344 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-98861d5c-06d3-4170-adac-fd1c73d3581c req-236df1cb-b6a9-40ad-a3c1-05f109dfb44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6363da42-8d2d-4e98-aabc-46fa6ca81bd7", "name": "network-vif-plugged", "status": "completed", "tag": "36e7c598-8df4-41e7-a656-c49754941c21"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:04.205168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-98861d5c-06d3-4170-adac-fd1c73d3581c req-236df1cb-b6a9-40ad-a3c1-05f109dfb44e service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:04.205820 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-98861d5c-06d3-4170-adac-fd1c73d3581c req-236df1cb-b6a9-40ad-a3c1-05f109dfb44e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:04.206521 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-98861d5c-06d3-4170-adac-fd1c73d3581c req-236df1cb-b6a9-40ad-a3c1-05f109dfb44e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:04.228727 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-98861d5c-06d3-4170-adac-fd1c73d3581c req-236df1cb-b6a9-40ad-a3c1-05f109dfb44e service nova] Creating event network-vif-plugged:36e7c598-8df4-41e7-a656-c49754941c21 for instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 on hv-cinder-85236 Aug 08 18:17:04.234253 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-98861d5c-06d3-4170-adac-fd1c73d3581c req-236df1cb-b6a9-40ad-a3c1-05f109dfb44e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042725 Aug 08 18:17:04.234866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 487/1009] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:04.257834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:04.258446 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:04.277820 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:04.279384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:04.279835 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:04.282486 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:04.282967 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:04.283414 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:04.443242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:04.451688 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-93d1839e-8203-437a-9f0f-67d1aeab74ae tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.198229 Aug 08 18:17:04.452684 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 523/1010] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:04 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:05.478023 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:05.478569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:05.486889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:05.487643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:05.489690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:05.489690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:05.489690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:05.491271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:05.675562 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:05.686992 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-edb13c45-57e8-4a36-ab96-a084fa95f466 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1264 microversion: 2.1 time: 0.213938 Aug 08 18:17:05.687572 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 488/1011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:05 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:06.711621 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:06.713076 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:06.721846 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:06.722576 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:06.723010 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:06.723901 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:06.724360 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:06.725374 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:06.879761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:06.888129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d4bdee16-f9b0-440b-abc7-503751f542cb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1451 microversion: 2.1 time: 0.181580 Aug 08 18:17:06.888829 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 524/1012] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:06 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1451 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:06.908854 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:06.910335 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:06.917374 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:06.917869 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:06.918313 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:06.919021 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:06.919531 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:06.919960 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:07.341739 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:07.349322 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-627d7f71-a681-489a-a943-ba79a668e5c4 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1451 microversion: 2.1 time: 0.444882 Aug 08 18:17:07.350514 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 489/1013] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:06 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1451 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:09.621717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-289531a2-4213-4df4-accf-15e2e4a77de3 req-7db2788c-1c22-47c3-8744-1dc15ca3400c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6363da42-8d2d-4e98-aabc-46fa6ca81bd7", "tag": "36e7c598-8df4-41e7-a656-c49754941c21"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:09.637104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-289531a2-4213-4df4-accf-15e2e4a77de3 req-7db2788c-1c22-47c3-8744-1dc15ca3400c service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:09.638101 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-289531a2-4213-4df4-accf-15e2e4a77de3 req-7db2788c-1c22-47c3-8744-1dc15ca3400c service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:09.639225 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-289531a2-4213-4df4-accf-15e2e4a77de3 req-7db2788c-1c22-47c3-8744-1dc15ca3400c service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:09.651651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-289531a2-4213-4df4-accf-15e2e4a77de3 req-7db2788c-1c22-47c3-8744-1dc15ca3400c service nova] Creating event network-changed:36e7c598-8df4-41e7-a656-c49754941c21 for instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 on hv-cinder-85236 Aug 08 18:17:09.657366 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-289531a2-4213-4df4-accf-15e2e4a77de3 req-7db2788c-1c22-47c3-8744-1dc15ca3400c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040768 Aug 08 18:17:09.658384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 525/1014] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:10.684613 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1603258822", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "networks": [{"uuid": "618562a5-75b5-4e3f-bab0-db440fa32f06"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:10.749881 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] validate_networks() for [('618562a5-75b5-4e3f-bab0-db440fa32f06', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:17:11.110331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:17:11.110331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:17:11.110331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:17:11.110614 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:17:11.110929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:17:11.120672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:11.121103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:11.121861 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:11.122778 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:11.123412 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:11.123847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:11.141582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Getting quotas for project 9e956c74d0ec4521b0a792e0e242b695. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:17:11.145831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Getting quotas for user 4d85e61124af4c69919f33e647e14c75 and project 9e956c74d0ec4521b0a792e0e242b695. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:17:11.156842 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:17:11.159190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:17:11.297870 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [d12157dc-ed71-49d5-8420-6208979459a0] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 18:17:12.308906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [d12157dc-ed71-49d5-8420-6208979459a0] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 60274. Aug 08 18:17:12.313470 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4986a044-49b8-49a2-9ac5-cd21f3b36eb2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.633458 Aug 08 18:17:12.314299 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 490/1015] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:17:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:17:12.326689 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c3b82105-0015-4e06-a888-74e30999581d tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:12.327386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c3b82105-0015-4e06-a888-74e30999581d tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:12.329353 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:12.387508 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c3b82105-0015-4e06-a888-74e30999581d tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:12.391673 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c3b82105-0015-4e06-a888-74e30999581d tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1214 microversion: 2.1 time: 0.069834 Aug 08 18:17:12.392312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 526/1016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:12 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:17:13.412304 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-583e0daf-5431-4546-a864-6fdd0fa1376b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:13.412970 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-583e0daf-5431-4546-a864-6fdd0fa1376b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:13.470454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-583e0daf-5431-4546-a864-6fdd0fa1376b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:13.477858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-583e0daf-5431-4546-a864-6fdd0fa1376b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1214 microversion: 2.1 time: 0.069862 Aug 08 18:17:13.478826 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 491/1017] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:13 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:14.498694 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:14.499315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:14.508284 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:14.508794 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:14.509223 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:14.509916 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:14.510364 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:14.510800 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:14.514989 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=71 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:14.576447 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:14.584067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f8027ca4-ea59-468b-b92d-475b04266235 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1266 microversion: 2.1 time: 0.089221 Aug 08 18:17:14.584648 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 527/1018] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:14 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:15.605534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:15.606788 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:15.614063 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:15.614634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:15.615346 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:15.616353 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:15.616787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:15.617193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:15.695645 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:15.703368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-98702a1f-0a9a-4750-8078-51c36d2c6121 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1272 microversion: 2.1 time: 0.101802 Aug 08 18:17:15.704127 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 492/1019] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:15 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:16.725632 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:16.726251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:16.735257 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:16.735741 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:16.736173 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:16.736888 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:16.737339 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:16.737756 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:16.834713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-cabca373-b717-42b2-baff-f96095176fa2 req-26da05f1-1017-4641-8de4-b37357d7e9ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5baeb3f9-0423-4137-9794-dfb1709654af", "tag": "ba4a7b9a-6db5-45b9-a185-f2a0518b1244"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:16.848383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cabca373-b717-42b2-baff-f96095176fa2 req-26da05f1-1017-4641-8de4-b37357d7e9ff service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:16.849408 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cabca373-b717-42b2-baff-f96095176fa2 req-26da05f1-1017-4641-8de4-b37357d7e9ff service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:16.850627 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cabca373-b717-42b2-baff-f96095176fa2 req-26da05f1-1017-4641-8de4-b37357d7e9ff service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:16.868691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-cabca373-b717-42b2-baff-f96095176fa2 req-26da05f1-1017-4641-8de4-b37357d7e9ff service nova] Creating event network-changed:ba4a7b9a-6db5-45b9-a185-f2a0518b1244 for instance 5baeb3f9-0423-4137-9794-dfb1709654af on hv-cinder-85236 Aug 08 18:17:16.874444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-cabca373-b717-42b2-baff-f96095176fa2 req-26da05f1-1017-4641-8de4-b37357d7e9ff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045841 Aug 08 18:17:16.875354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 493/1020] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:17:16.948640 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:16.956681 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3630ac46-5138-4228-9a5d-00de1c09d700 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1314 microversion: 2.1 time: 0.235462 Aug 08 18:17:16.957262 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 528/1021] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:16 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:17.979557 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:17.981007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:17.987204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:17.987802 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:17.988628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:17.989401 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:17.989951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:17.991097 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:17.995481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=75 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:18.133378 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:18.140724 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e289bf53-1b20-4300-9bad-9a4653a76c5a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1314 microversion: 2.1 time: 0.166696 Aug 08 18:17:18.141297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 494/1022] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:17 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:19.160944 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:19.161553 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:19.167830 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:19.168315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:19.168847 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:19.170521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:19.175808 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:19.175808 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:19.323570 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:19.331794 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b58dd48f-300a-4327-8be2-b085dd6dfc74 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1314 microversion: 2.1 time: 0.174361 Aug 08 18:17:19.332366 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 529/1023] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:19 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:17:20.351722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:20.352481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:20.358121 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:20.360240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:20.360797 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:20.361438 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:20.362130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:20.362582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:20.363001 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:20.507709 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:20.515596 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ac27aae0-cd94-482c-b922-78c55ae2d703 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1314 microversion: 2.1 time: 0.167685 Aug 08 18:17:20.516164 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 495/1024] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:20 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:21.538389 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:21.539113 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:21.546827 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:21.547322 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:21.548825 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:21.548825 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:21.549401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:21.549507 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:21.703922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:21.714901 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-617149b5-d6fb-438f-9d36-52f353bd457f tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1314 microversion: 2.1 time: 0.182012 Aug 08 18:17:21.715868 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 530/1025] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:21 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:22.328073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-93c6e634-1884-44fd-aeeb-b43171268e00 req-8970fe47-b62a-4c21-b2fb-96f8c1d3e94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5baeb3f9-0423-4137-9794-dfb1709654af", "name": "network-vif-plugged", "status": "completed", "tag": "ba4a7b9a-6db5-45b9-a185-f2a0518b1244"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:22.333348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:22.339227 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-93c6e634-1884-44fd-aeeb-b43171268e00 req-8970fe47-b62a-4c21-b2fb-96f8c1d3e94c service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:22.339707 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-93c6e634-1884-44fd-aeeb-b43171268e00 req-8970fe47-b62a-4c21-b2fb-96f8c1d3e94c service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:22.340134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-93c6e634-1884-44fd-aeeb-b43171268e00 req-8970fe47-b62a-4c21-b2fb-96f8c1d3e94c service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:22.351828 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-93c6e634-1884-44fd-aeeb-b43171268e00 req-8970fe47-b62a-4c21-b2fb-96f8c1d3e94c service nova] Creating event network-vif-plugged:ba4a7b9a-6db5-45b9-a185-f2a0518b1244 for instance 5baeb3f9-0423-4137-9794-dfb1709654af on hv-cinder-85236 Aug 08 18:17:22.356898 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-93c6e634-1884-44fd-aeeb-b43171268e00 req-8970fe47-b62a-4c21-b2fb-96f8c1d3e94c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032805 Aug 08 18:17:22.357500 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 496/1026] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:22.740761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:22.741401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:22.743250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:22.748356 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:22.749903 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:22.749903 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:22.750110 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:22.750631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:22.751240 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:22.898479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:22.906063 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-86f8d640-dd59-418d-b509-f67ffe484a0e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1314 microversion: 2.1 time: 0.169678 Aug 08 18:17:22.906627 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 531/1027] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:22 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:23.924298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=8 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:23.929554 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:23.930258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:23.936958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:23.937443 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:23.937880 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:23.938576 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:23.939066 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:23.939489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:24.089094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:24.096943 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-190ceccb-9436-4668-ae2f-8fa2d4d9227c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1314 microversion: 2.1 time: 0.173869 Aug 08 18:17:24.097527 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 497/1028] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:23 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:25.119633 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:25.120298 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:25.126816 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:25.127305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:25.127742 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:25.128438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:25.128943 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:25.129381 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:25.271801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:25.279282 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2154788f-20d7-4528-88d0-0e69b4b6131b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1499 microversion: 2.1 time: 0.164311 Aug 08 18:17:25.279841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 532/1029] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:25 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:26.506952 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:26.507453 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:26.513781 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:26.514258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:26.514690 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:26.515430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:26.515819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:26.516238 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:26.541333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:17:26.779298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c543cf6b-ffbf-4711-b1c8-7c34a03d7345 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 204 len: 0 microversion: 2.1 time: 0.276384 Aug 08 18:17:26.782317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 498/1030] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:17:26 2022] DELETE /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:17:26.789042 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:26.789654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:26.796641 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:26.797126 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:26.797561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:26.798261 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:26.798713 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:26.799138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:26.939362 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:26.947467 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7e566121-0ece-4e30-9044-31ae4ed91db1 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1505 microversion: 2.1 time: 0.162337 Aug 08 18:17:26.948119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 533/1031] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:26 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:27.971307 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:27.971999 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:27.978398 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:27.978804 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:27.979236 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:27.979920 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:27.980372 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:27.984175 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:28.112968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:28.120966 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ab967578-25c4-49db-bd4a-65115b74a066 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1505 microversion: 2.1 time: 0.153921 Aug 08 18:17:28.121527 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 499/1032] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:27 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:29.071039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-cdc550b4-e048-4514-97db-3ea197aae2ad req-557cbd66-f2e9-4c54-af18-b02cfdf2c912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5baeb3f9-0423-4137-9794-dfb1709654af", "name": "network-vif-deleted", "tag": "ba4a7b9a-6db5-45b9-a185-f2a0518b1244"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:29.080658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-cdc550b4-e048-4514-97db-3ea197aae2ad req-557cbd66-f2e9-4c54-af18-b02cfdf2c912 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:29.081127 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-cdc550b4-e048-4514-97db-3ea197aae2ad req-557cbd66-f2e9-4c54-af18-b02cfdf2c912 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:29.081804 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-cdc550b4-e048-4514-97db-3ea197aae2ad req-557cbd66-f2e9-4c54-af18-b02cfdf2c912 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:29.093451 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-cdc550b4-e048-4514-97db-3ea197aae2ad req-557cbd66-f2e9-4c54-af18-b02cfdf2c912 service nova] Creating event network-vif-deleted:ba4a7b9a-6db5-45b9-a185-f2a0518b1244 for instance 5baeb3f9-0423-4137-9794-dfb1709654af on hv-cinder-85236 Aug 08 18:17:29.098526 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-cdc550b4-e048-4514-97db-3ea197aae2ad req-557cbd66-f2e9-4c54-af18-b02cfdf2c912 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031363 Aug 08 18:17:29.099102 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 534/1033] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:29.142235 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:29.142858 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:29.149852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:29.150337 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:29.150776 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:29.151491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:29.151974 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:29.152397 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:29.215941 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:29.223734 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9a94561e-096c-4cc2-a02d-966df2f5837e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 200 len: 1463 microversion: 2.1 time: 0.085480 Aug 08 18:17:29.224302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 500/1034] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:29 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 1463 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:30.247135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:30.248075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 5baeb3f9-0423-4137-9794-dfb1709654af] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:30.255203 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:30.255713 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:30.260880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:30.260880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:30.260880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:30.260880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:30.272346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] HTTP exception thrown: Instance 5baeb3f9-0423-4137-9794-dfb1709654af could not be found. Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Request method failure captured: Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af HTTP/1.1 Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VMk7lCVXVv2QLEsXJ-Vrac5QNG6crnS8EkC484L18bkwyAEeVIGk8MhVCPHPk7UjIYB7uAwro6vX39uchge6itm69DPs3ck1TCl-ylJhn9L57cAx2bA_qqZ7xqKWZQD9slYuXRFLRpS0B9RRCXPWzSYmqjZUf-_309y426Rrn6YQoE Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: 9e956c74d0ec4521b0a792e0e242b695 Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesActionsTest-2014327285 Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:17:30.274001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e956c74d0ec4521b0a792e0e242b695"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e956c74d0ec4521b0a792e0e242b695", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e956c74d0ec4521b0a792e0e242b695"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e956c74d0ec4521b0a792e0e242b695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesActionsTest-2014327285 Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: 9e956c74d0ec4521b0a792e0e242b695 Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesActionsTest-2014327285 Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesActionsTest-2014327285-project Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 4d85e61124af4c69919f33e647e14c75 Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesActionsTest-2014327285-project Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 5baeb3f9-0423-4137-9794-dfb1709654af could not be found. Aug 08 18:17:30.275668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '5baeb3f9-0423-4137-9794-dfb1709654af'} Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5baeb3f9-0423-4137-9794-dfb1709654af could not be found. Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:17:30.276555 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5baeb3f9-0423-4137-9794-dfb1709654af could not be found. Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5baeb3f9-0423-4137-9794-dfb1709654af could not be found. Aug 08 18:17:30.277891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:17:30.279144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Returning 404 to user: Instance 5baeb3f9-0423-4137-9794-dfb1709654af could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:17:30.279144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c3215c2d-8d18-4053-958e-c9e447b5d64e tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af" status: 404 len: 111 microversion: 2.1 time: 0.033701 Aug 08 18:17:30.279144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 535/1035] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:30 2022] GET /compute/v2.1/servers/5baeb3f9-0423-4137-9794-dfb1709654af => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:17:30.379626 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1479282661", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "networks": [{"uuid": "618562a5-75b5-4e3f-bab0-db440fa32f06"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:30.431613 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] validate_networks() for [('618562a5-75b5-4e3f-bab0-db440fa32f06', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:17:30.783577 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:17:30.783994 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:17:30.784474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:17:30.784918 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:17:30.785338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:17:30.794480 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:30.794967 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:30.795402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:30.796140 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:30.796627 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:30.797068 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:30.814315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Getting quotas for project 9e956c74d0ec4521b0a792e0e242b695. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:17:30.818491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Getting quotas for user 4d85e61124af4c69919f33e647e14c75 and project 9e956c74d0ec4521b0a792e0e242b695. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:17:30.830197 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:17:30.832734 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:17:30.952387 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2bcefd90-6846-4566-8738-83dc8d3c19a2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576603 Aug 08 18:17:30.953129 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 501/1036] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:17:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:17:30.964768 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-de34d3f5-f69c-4be9-9747-7b1d68796dee tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:30.966228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-de34d3f5-f69c-4be9-9747-7b1d68796dee tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:31.027694 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-de34d3f5-f69c-4be9-9747-7b1d68796dee tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:31.035729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-de34d3f5-f69c-4be9-9747-7b1d68796dee tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1214 microversion: 2.1 time: 0.074826 Aug 08 18:17:31.056675 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 536/1037] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:30 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:32.065727 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:32.066355 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:32.073241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:32.082860 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:32.082860 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:32.082860 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:32.082860 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:32.083276 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:32.140073 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:32.149959 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-24a21748-0479-4a7d-a93f-0c1d08a9b7af tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1218 microversion: 2.1 time: 0.088651 Aug 08 18:17:32.151101 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 502/1038] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:32 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:33.173556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:33.174144 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:33.181679 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:33.182164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:33.182598 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:33.183295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:33.183755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:33.184174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:33.262721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:33.274082 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-edeaaf59-b4b7-4a78-ab57-c9f548fa182b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1274 microversion: 2.1 time: 0.104301 Aug 08 18:17:33.275772 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 537/1039] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:33 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:34.303152 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:34.303766 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:34.311161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:34.312043 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:34.312532 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:34.317704 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:34.317704 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:34.317704 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:34.491876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:34.499201 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-83655b49-1cfe-45fd-a06c-460d509b2cdb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1314 microversion: 2.1 time: 0.199938 Aug 08 18:17:34.499768 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 503/1040] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:34 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:34.831523 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-42a468e0-c3a0-4e5b-bfaa-cbbd081b84c7 req-ea20b2e2-e47a-40ee-bd3f-b0e044a97676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d346e26-86a1-4d50-a754-59a8b768872f", "tag": "228dfd57-2bea-40a7-89fc-36006a776446"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:34.854234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-42a468e0-c3a0-4e5b-bfaa-cbbd081b84c7 req-ea20b2e2-e47a-40ee-bd3f-b0e044a97676 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:34.854234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-42a468e0-c3a0-4e5b-bfaa-cbbd081b84c7 req-ea20b2e2-e47a-40ee-bd3f-b0e044a97676 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:34.854234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-42a468e0-c3a0-4e5b-bfaa-cbbd081b84c7 req-ea20b2e2-e47a-40ee-bd3f-b0e044a97676 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:34.877116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-42a468e0-c3a0-4e5b-bfaa-cbbd081b84c7 req-ea20b2e2-e47a-40ee-bd3f-b0e044a97676 service nova] Creating event network-changed:228dfd57-2bea-40a7-89fc-36006a776446 for instance 1d346e26-86a1-4d50-a754-59a8b768872f on hv-cinder-85236 Aug 08 18:17:34.886495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-42a468e0-c3a0-4e5b-bfaa-cbbd081b84c7 req-ea20b2e2-e47a-40ee-bd3f-b0e044a97676 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058579 Aug 08 18:17:34.887125 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 538/1041] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:35.520268 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:35.520947 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:35.528191 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:35.528700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:35.529137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:35.529832 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:35.530335 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:35.530842 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:35.722823 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:35.730491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-77bb4e20-4a67-43e5-9294-d6401f1c0624 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1314 microversion: 2.1 time: 0.214146 Aug 08 18:17:35.731123 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 504/1042] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:35 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:36.751732 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:36.752433 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:36.759475 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:36.759961 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:36.761413 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:36.761413 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:36.761705 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:36.762135 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:36.898418 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:36.906073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-d87a2202-315a-4005-a0ce-2c1ab0ae9af0 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1314 microversion: 2.1 time: 0.158606 Aug 08 18:17:36.906816 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 539/1043] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:36 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:37.926643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:37.927267 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:37.933717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:37.934203 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:37.934643 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:37.935338 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:37.935800 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:37.936281 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:38.072651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:38.080106 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3c85af9f-757c-4a5e-b8c5-96bc9d0516bb tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1314 microversion: 2.1 time: 0.157421 Aug 08 18:17:38.080692 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 505/1044] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:37 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:38.935463 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1004007406", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "networks": [{"uuid": "56f79f43-23fc-4ba0-a230-01eab48112f9"}]}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:38.987711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] validate_networks() for [('56f79f43-23fc-4ba0-a230-01eab48112f9', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:17:39.101541 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:39.102165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:39.109199 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:39.109917 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:39.110410 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:39.111058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:39.111819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:39.112251 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:39.579586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:39.588212 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-27f5fdc1-4486-4470-93e5-1030317a5d6a tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1314 microversion: 2.1 time: 0.491546 Aug 08 18:17:39.588822 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 506/1045] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:39 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:17:39.665914 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:17:39.666341 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:17:39.666843 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:17:39.667251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:17:39.667661 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:17:39.676408 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:39.676880 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:39.677297 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:39.678025 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:39.678480 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:39.678906 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:39.696163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Getting quotas for project a7a885b9c1574a8eb0a62b5253c9f8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:17:39.700156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Getting quotas for user 6ae6453ca9ec4a4eb3ec2e25900810cc and project a7a885b9c1574a8eb0a62b5253c9f8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:17:39.711857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:17:39.714088 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:17:39.843764 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c54edeff-6774-4130-b9ca-8551e84c7e3e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912018 Aug 08 18:17:39.844431 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 540/1046] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:17:39.854934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-90844c36-61c8-421d-99cb-7e6285b9dd80 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:39.855545 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-90844c36-61c8-421d-99cb-7e6285b9dd80 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:39.911770 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-90844c36-61c8-421d-99cb-7e6285b9dd80 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:39.918416 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-90844c36-61c8-421d-99cb-7e6285b9dd80 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1219 microversion: 2.1 time: 0.067278 Aug 08 18:17:39.918977 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 507/1047] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:39 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:40.439748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-8d25bbda-5adf-4cba-a79f-cf887de7ec0f req-0fbce1e3-9ac0-4ba7-b0ad-4b8551d9a3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d346e26-86a1-4d50-a754-59a8b768872f", "name": "network-vif-plugged", "status": "completed", "tag": "228dfd57-2bea-40a7-89fc-36006a776446"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:40.450032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-8d25bbda-5adf-4cba-a79f-cf887de7ec0f req-0fbce1e3-9ac0-4ba7-b0ad-4b8551d9a3eb service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:40.450513 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-8d25bbda-5adf-4cba-a79f-cf887de7ec0f req-0fbce1e3-9ac0-4ba7-b0ad-4b8551d9a3eb service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:40.450990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-8d25bbda-5adf-4cba-a79f-cf887de7ec0f req-0fbce1e3-9ac0-4ba7-b0ad-4b8551d9a3eb service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:40.461758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-8d25bbda-5adf-4cba-a79f-cf887de7ec0f req-0fbce1e3-9ac0-4ba7-b0ad-4b8551d9a3eb service nova] Creating event network-vif-plugged:228dfd57-2bea-40a7-89fc-36006a776446 for instance 1d346e26-86a1-4d50-a754-59a8b768872f on hv-cinder-85236 Aug 08 18:17:40.466873 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-8d25bbda-5adf-4cba-a79f-cf887de7ec0f req-0fbce1e3-9ac0-4ba7-b0ad-4b8551d9a3eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031456 Aug 08 18:17:40.467700 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 541/1048] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:40.610256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:40.610974 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:40.617949 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:40.618444 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:40.618881 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:40.619579 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:40.620034 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:40.620459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:40.751715 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:40.759881 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a30ed680-b5aa-4a57-a9bb-a28f7458ec45 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1314 microversion: 2.1 time: 0.154325 Aug 08 18:17:40.760454 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 508/1049] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:40 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:40.939400 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:40.940108 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:40.946950 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:40.951250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:40.951250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:40.951250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:40.951250 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:40.951668 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:41.013654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:41.021199 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-80e3942f-b40d-409e-8c20-2bea706a3b31 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1223 microversion: 2.1 time: 0.086045 Aug 08 18:17:41.021770 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 542/1050] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:40 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:41.780637 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:41.781245 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:41.783204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:41.789106 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:41.789638 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:41.790072 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:41.790770 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:41.791216 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:41.791632 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:41.922331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:41.929816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9333bceb-51ce-40a1-8050-5754d27420ac tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1314 microversion: 2.1 time: 0.153075 Aug 08 18:17:41.930365 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 509/1051] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:41 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:42.041556 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:42.042169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:42.048486 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:42.048998 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:42.049463 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:42.050157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:42.050706 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:42.051140 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:42.112342 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:42.119786 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4947c423-0d47-49aa-a43e-093d4934ae45 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1271 microversion: 2.1 time: 0.082137 Aug 08 18:17:42.120366 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 543/1052] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:42 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:42.950187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:42.950807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:42.958128 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:42.958611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:42.959065 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:42.959755 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:42.960214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:42.960674 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:43.140931 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:43.141806 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:43.150181 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:43.150664 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:43.151146 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:43.151849 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:43.152433 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:43.153021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:43.153808 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:43.163384 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a9e324dd-4f32-4dbd-a30f-ec5ec2ce488b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1499 microversion: 2.1 time: 0.217088 Aug 08 18:17:43.165161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 510/1053] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:42 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1499 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:43.285351 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:43.294837 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a6a6eece-3de0-43d8-828e-bc6a941eade9 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1279 microversion: 2.1 time: 0.157666 Aug 08 18:17:43.308276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 544/1054] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:43 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:17:44.137473 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:44.137980 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:44.144023 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:44.145950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:44.145950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:44.145950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:44.147112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:44.147112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:44.162082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:44.172663 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:17:44.315755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:44.316320 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:44.323532 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:44.324011 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:44.324446 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:44.325169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:44.325647 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:44.326069 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:44.452478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ae4cbb0c-f051-475d-a9e4-ee450bdf6b4c tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 204 len: 0 microversion: 2.1 time: 0.318518 Aug 08 18:17:44.453122 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 511/1055] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:17:44 2022] DELETE /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:17:44.462897 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:44.463611 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:44.470523 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:44.471013 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:44.471449 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:44.472306 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:44.472807 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:44.473286 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:44.514332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:44.521956 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4cffc930-df1b-4d27-a5ae-b9694074a7e7 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.210643 Aug 08 18:17:44.522615 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 545/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:44 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:17:44.708532 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:44.715669 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-585c4522-54e7-4d57-897b-31d4579aae90 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1505 microversion: 2.1 time: 0.257601 Aug 08 18:17:44.719000 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 512/1057] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:44 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:17:44.876022 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-57d2c15f-37f7-4d50-8cfa-2f30ac251445 req-db571670-9c79-4003-b975-da076a42e50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e293101-e85f-4f50-a9ec-b8a174b6b1f4", "tag": "61d724b9-a73b-4161-81fe-44d17b4ff1c0"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:44.881039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:44.886103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-57d2c15f-37f7-4d50-8cfa-2f30ac251445 req-db571670-9c79-4003-b975-da076a42e50e service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:44.887707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-57d2c15f-37f7-4d50-8cfa-2f30ac251445 req-db571670-9c79-4003-b975-da076a42e50e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:44.887707 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-57d2c15f-37f7-4d50-8cfa-2f30ac251445 req-db571670-9c79-4003-b975-da076a42e50e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:44.890868 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=88 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:44.898071 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-57d2c15f-37f7-4d50-8cfa-2f30ac251445 req-db571670-9c79-4003-b975-da076a42e50e service nova] Creating event network-changed:61d724b9-a73b-4161-81fe-44d17b4ff1c0 for instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 on hv-cinder-85236 Aug 08 18:17:44.902797 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-57d2c15f-37f7-4d50-8cfa-2f30ac251445 req-db571670-9c79-4003-b975-da076a42e50e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030439 Aug 08 18:17:44.908245 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 546/1058] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:45.543114 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:45.543722 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:45.550367 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:45.550849 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:45.551284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:45.552064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:45.552543 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:45.552965 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:45.685641 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:45.692957 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cfc2b772-302b-4a2f-a9bb-f858f360283f tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.153714 Aug 08 18:17:45.694007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 513/1059] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:45 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:45.737539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:45.738244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:45.745022 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:45.745507 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:45.745947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:45.746633 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:45.747092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:45.747549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:45.882210 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:45.889663 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-b00f180f-6342-48db-92ef-7e7e36d2a0e5 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1505 microversion: 2.1 time: 0.157180 Aug 08 18:17:45.890220 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 547/1060] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:45 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:46.714239 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:46.714841 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:46.721267 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:46.721755 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:46.722196 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:46.722889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:46.723348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:46.723921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:46.865167 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:46.872817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0c1526da-a5f8-4cba-a8c5-b55e7430b287 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.162910 Aug 08 18:17:46.873393 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 514/1061] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:46 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:46.910687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:46.911299 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:46.918350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:46.918860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:46.919291 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:46.919976 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:46.920424 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:46.920871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:47.049259 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:47.057056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2da96997-a974-4e47-b2c7-8b04ab79cb50 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1505 microversion: 2.1 time: 0.150174 Aug 08 18:17:47.057903 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 548/1062] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:46 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:47.893112 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:47.893736 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:47.900106 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:47.900630 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:47.901076 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:47.901777 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:47.902237 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:47.902663 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:48.035559 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:48.043687 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-202aff1e-4811-430b-9b1f-074c79ff1b39 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.154361 Aug 08 18:17:48.044268 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 515/1063] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:47 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:48.077977 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:48.078539 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:48.085230 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:48.085709 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:48.086142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:48.086827 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:48.087277 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:48.087695 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:48.228403 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:48.235952 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2ea0af6e-5331-4f50-9a98-19038f9b12dc tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1505 microversion: 2.1 time: 0.161886 Aug 08 18:17:48.236742 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 549/1064] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:48 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:49.065108 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:49.065732 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:49.072835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:49.073330 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:49.073906 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:49.074628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:49.075090 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:49.075534 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:49.260034 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:49.260780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:49.268739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:49.269364 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:49.269899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:49.270694 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:49.271425 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:49.271793 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:49.382504 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:49.390792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2e66e2d2-9121-4d16-ba37-a74fbf0cdfa6 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1463 microversion: 2.1 time: 0.137104 Aug 08 18:17:49.396217 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 550/1065] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:49 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:49.405330 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-7dff2d2c-0196-436e-a9e2-54c29784f968 req-4df59024-28e4-4368-9ef7-682f62e56ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d346e26-86a1-4d50-a754-59a8b768872f", "name": "network-vif-deleted", "tag": "228dfd57-2bea-40a7-89fc-36006a776446"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:49.405455 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:49.410766 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-628651c3-6b52-4e2e-a142-8158c542f773 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.349421 Aug 08 18:17:49.418056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-7dff2d2c-0196-436e-a9e2-54c29784f968 req-4df59024-28e4-4368-9ef7-682f62e56ae5 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:49.418485 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-7dff2d2c-0196-436e-a9e2-54c29784f968 req-4df59024-28e4-4368-9ef7-682f62e56ae5 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:49.418913 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-7dff2d2c-0196-436e-a9e2-54c29784f968 req-4df59024-28e4-4368-9ef7-682f62e56ae5 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:49.423468 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 516/1066] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:49 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:49.432841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-7dff2d2c-0196-436e-a9e2-54c29784f968 req-4df59024-28e4-4368-9ef7-682f62e56ae5 service nova] Creating event network-vif-deleted:228dfd57-2bea-40a7-89fc-36006a776446 for instance 1d346e26-86a1-4d50-a754-59a8b768872f on hv-cinder-85236 Aug 08 18:17:49.437728 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-7dff2d2c-0196-436e-a9e2-54c29784f968 req-4df59024-28e4-4368-9ef7-682f62e56ae5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044697 Aug 08 18:17:49.438518 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 551/1067] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:50.411997 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:50.412682 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:50.414649 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=8 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:50.420092 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:50.425376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:50.425376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:50.425376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:50.425376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:50.425730 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:50.429205 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:50.429970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=8 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:50.434430 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:50.435129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:50.441319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:50.441796 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:50.442232 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:50.442921 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:50.443876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:50.444299 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:50.457571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:50.457571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:50.457948 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:50.458386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lazy-loading 'fault' on Instance uuid 1d346e26-86a1-4d50-a754-59a8b768872f {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:17:50.504617 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d85e61124af4c69919f33e647e14c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e956c74d0ec4521b0a792e0e242b695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:50.512941 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-226f067c-8643-4039-a62f-f949047ef13b tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 200 len: 1304 microversion: 2.1 time: 0.104807 Aug 08 18:17:50.513510 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 517/1068] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:50 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:50.608478 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:50.616574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-bca65ab2-ee9d-4fc8-9648-ac274f8c003c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.188326 Aug 08 18:17:50.617145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 552/1069] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:50 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:51.534107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:51.534651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] [instance: 1d346e26-86a1-4d50-a754-59a8b768872f] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:51.541678 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:51.542168 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:51.542607 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:51.543301 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:51.543757 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:51.544183 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:51.557565 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] HTTP exception thrown: Instance 1d346e26-86a1-4d50-a754-59a8b768872f could not be found. Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Request method failure captured: Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f HTTP/1.1 Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VMk7lCVXVv2QLEsXJ-Vrac5QNG6crnS8EkC484L18bkwyAEeVIGk8MhVCPHPk7UjIYB7uAwro6vX39uchge6itm69DPs3ck1TCl-ylJhn9L57cAx2bA_qqZ7xqKWZQD9slYuXRFLRpS0B9RRCXPWzSYmqjZUf-_309y426Rrn6YQoE Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: 9e956c74d0ec4521b0a792e0e242b695 Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesActionsTest-2014327285 Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:17:51.559254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9e956c74d0ec4521b0a792e0e242b695"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9e956c74d0ec4521b0a792e0e242b695", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e956c74d0ec4521b0a792e0e242b695"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9e956c74d0ec4521b0a792e0e242b695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesActionsTest-2014327285 Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 9e956c74d0ec4521b0a792e0e242b695 Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesActionsTest-2014327285 Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesActionsTest-2014327285-project Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 4d85e61124af4c69919f33e647e14c75 Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesActionsTest-2014327285-project Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 1d346e26-86a1-4d50-a754-59a8b768872f could not be found. Aug 08 18:17:51.561003 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '1d346e26-86a1-4d50-a754-59a8b768872f'} Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d346e26-86a1-4d50-a754-59a8b768872f could not be found. Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:17:51.561850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d346e26-86a1-4d50-a754-59a8b768872f could not be found. Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d346e26-86a1-4d50-a754-59a8b768872f could not be found. Aug 08 18:17:51.563187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:17:51.564390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] Returning 404 to user: Instance 1d346e26-86a1-4d50-a754-59a8b768872f could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:17:51.564390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8fd15022-48b8-4a21-9fd6-c365ab7534f2 tempest-VolumesActionsTest-2014327285 tempest-VolumesActionsTest-2014327285-project] 10.222.0.50 "GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f" status: 404 len: 111 microversion: 2.1 time: 0.030538 Aug 08 18:17:51.564390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 518/1070] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:51 2022] GET /compute/v2.1/servers/1d346e26-86a1-4d50-a754-59a8b768872f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:17:51.637962 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:51.638579 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:51.645416 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:51.645908 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:51.646345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:51.647706 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:51.648165 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:51.648687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:51.782111 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:51.789801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f41ee966-8a67-4274-bfc6-66e58747db10 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.155629 Aug 08 18:17:51.790401 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 553/1071] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:51 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:52.810855 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:52.811432 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:52.813377 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:17:52.818232 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:52.818989 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:52.819493 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:52.820490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:52.821214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:52.821908 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:52.968364 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:52.976895 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c8755d97-357c-4090-ac5a-029529ea44c0 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.170389 Aug 08 18:17:52.977623 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 519/1072] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:52 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:53.997252 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:53.997774 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:54.004306 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:54.004844 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:54.005314 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:54.006032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:54.006487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:54.007087 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:54.135693 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:54.143879 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-09a763aa-f908-4ca3-9448-37e17f9ef1bc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.150496 Aug 08 18:17:54.144495 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 554/1073] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:53 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:55.164814 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:55.165421 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:55.172333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:55.172831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:55.173261 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:55.173938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:55.174406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:55.174826 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:55.302282 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:55.310875 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-55523bb9-b55e-449a-b1dd-2336f57e7f41 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.150050 Aug 08 18:17:55.311385 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 520/1074] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:55 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:56.333487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:56.334096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:56.341132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:56.341609 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:56.342043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:56.342735 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:56.343190 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:56.343620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:56.474231 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:56.481654 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-cb8ecb4c-d7e5-4bbf-8653-b849f35d8b85 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.152252 Aug 08 18:17:56.482225 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 555/1075] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:56 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:57.503150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:57.504694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:57.511942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:57.512553 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:57.513091 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:57.513893 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:57.514440 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:57.514961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:57.667495 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:57.675664 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e4239d4a-4846-436a-9890-f8345b6f9035 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.176713 Aug 08 18:17:57.676247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 521/1076] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:57 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:57.990706 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-757eea7e-48c7-424e-af6f-4e0ff8898c09 req-6c0d9548-3ddf-47fb-b4c1-d7469f8c9fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e293101-e85f-4f50-a9ec-b8a174b6b1f4", "name": "network-vif-plugged", "status": "completed", "tag": "61d724b9-a73b-4161-81fe-44d17b4ff1c0"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:17:58.003747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-757eea7e-48c7-424e-af6f-4e0ff8898c09 req-6c0d9548-3ddf-47fb-b4c1-d7469f8c9fe4 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:58.004573 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-757eea7e-48c7-424e-af6f-4e0ff8898c09 req-6c0d9548-3ddf-47fb-b4c1-d7469f8c9fe4 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:58.005602 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-757eea7e-48c7-424e-af6f-4e0ff8898c09 req-6c0d9548-3ddf-47fb-b4c1-d7469f8c9fe4 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:58.019616 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-757eea7e-48c7-424e-af6f-4e0ff8898c09 req-6c0d9548-3ddf-47fb-b4c1-d7469f8c9fe4 service nova] Creating event network-vif-plugged:61d724b9-a73b-4161-81fe-44d17b4ff1c0 for instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 on hv-cinder-85236 Aug 08 18:17:58.026606 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-757eea7e-48c7-424e-af6f-4e0ff8898c09 req-6c0d9548-3ddf-47fb-b4c1-d7469f8c9fe4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041406 Aug 08 18:17:58.027610 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 556/1077] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:17:58.697667 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:58.699008 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:58.707308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:58.707816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:58.708486 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:58.709164 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:58.709766 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:58.710934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:58.864319 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:17:58.872750 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a7492528-c567-4081-9cf0-2f6da6da438e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1319 microversion: 2.1 time: 0.179521 Aug 08 18:17:58.873774 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 522/1078] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:58 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:17:59.895785 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:17:59.977089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:17:59.977089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:59.977089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:59.977089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:17:59.978139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:17:59.978139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:17:59.978139 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:00.046561 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:18:00.054210 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8d2983b0-cff4-4c4e-ad81-45fba73089d1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1508 microversion: 2.1 time: 0.163467 Aug 08 18:18:00.054771 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 557/1079] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:17:59 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:18:20.956363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cae48bb-f32b-4dc6-842e-dda7c8fc6c93", "device": "/dev/sdb"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:18:20.959694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:18:20.962186 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=7 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:18:20.962852 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:18:20.967457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:20.967938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:20.968376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:20.969096 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:20.969547 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:20.969971 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:21.730151 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-709cf322-361a-4621-b0a0-f3bf0be95dff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "POST /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777611 Aug 08 18:18:21.730765 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 523/1080] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:18:20 2022] POST /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:18:46.320802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:18:46.321234 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:18:46.323315 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=23 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:18:46.324132 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=59 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:18:46.328632 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:46.329116 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:46.329557 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:46.330293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:46.330752 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:46.331180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:46.412527 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lazy-loading 'services' on Instance uuid 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:18:46.628672 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a9b0c08c-bd98-48ed-a2a1-6b8538857dbd tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4/os-volume_attachments/4cae48bb-f32b-4dc6-842e-dda7c8fc6c93" status: 202 len: 0 microversion: 2.1 time: 0.311841 Aug 08 18:18:46.629266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 558/1081] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:18:46 2022] DELETE /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4/os-volume_attachments/4cae48bb-f32b-4dc6-842e-dda7c8fc6c93 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:18:50.915089 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:18:50.915677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:18:50.918167 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:18:50.918835 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:18:50.924198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:50.924721 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:50.925193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:50.925889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:50.926348 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:50.926776 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:50.952377 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:18:51.224163 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-03fac25a-bf86-414b-b9d8-413951da54a1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 204 len: 0 microversion: 2.1 time: 0.313025 Aug 08 18:18:51.224827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 524/1082] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:18:50 2022] DELETE /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:18:51.233581 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:18:51.236264 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:18:51.241979 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:51.242639 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:51.243089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:51.243787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:51.244244 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:51.244755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:51.375792 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:18:51.384143 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a078e7d8-34fa-423a-84d8-ac6ed7a69dc4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1514 microversion: 2.1 time: 0.154940 Aug 08 18:18:51.384737 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 559/1083] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:18:51 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:18:52.405527 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:18:52.406217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:18:52.412221 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:52.412700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:52.413143 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:52.413854 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:52.414295 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:52.414726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:52.723156 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:18:52.730593 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5c32eba8-e6bb-44b2-9c0f-3eb80253aef4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1514 microversion: 2.1 time: 0.329664 Aug 08 18:18:52.731165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 525/1084] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:18:52 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:18:53.533054 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-191d5907-418b-48f1-965d-98540759d1bb req-1aec111f-0c5a-4ae1-86be-92b9a6dbbeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e293101-e85f-4f50-a9ec-b8a174b6b1f4", "name": "network-vif-deleted", "tag": "61d724b9-a73b-4161-81fe-44d17b4ff1c0"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:18:53.542816 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-191d5907-418b-48f1-965d-98540759d1bb req-1aec111f-0c5a-4ae1-86be-92b9a6dbbeb6 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:53.543293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-191d5907-418b-48f1-965d-98540759d1bb req-1aec111f-0c5a-4ae1-86be-92b9a6dbbeb6 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:53.543721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-191d5907-418b-48f1-965d-98540759d1bb req-1aec111f-0c5a-4ae1-86be-92b9a6dbbeb6 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:53.555020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-191d5907-418b-48f1-965d-98540759d1bb req-1aec111f-0c5a-4ae1-86be-92b9a6dbbeb6 service nova] Creating event network-vif-deleted:61d724b9-a73b-4161-81fe-44d17b4ff1c0 for instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 on hv-cinder-85236 Aug 08 18:18:53.560161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-191d5907-418b-48f1-965d-98540759d1bb req-1aec111f-0c5a-4ae1-86be-92b9a6dbbeb6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033328 Aug 08 18:18:53.560838 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 560/1085] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:18:53.752244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:18:53.755801 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:18:53.760126 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:53.760679 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:53.761125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:53.761845 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:53.762303 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:53.762726 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:53.831165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:18:53.847733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7417367a-fe1e-4f5f-85df-eea9537af9ac tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 200 len: 1304 microversion: 2.1 time: 0.098943 Aug 08 18:18:53.861187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 526/1086] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:18:53 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:18:54.868337 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:18:54.869059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 1e293101-e85f-4f50-a9ec-b8a174b6b1f4] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:18:54.875568 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:54.876048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:54.876481 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:54.877189 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:18:54.877642 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:18:54.878066 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:18:54.890939 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] HTTP exception thrown: Instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 could not be found. Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Request method failure captured: Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 HTTP/1.1 Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VNBqQnpnrNPF_wTYg4WVv-B1n9fEY6XzoUeoNNy3XcoFku6L9RRZCl-idI6lFT75UfEz7dA7ayrj9rqEFRSTUB3aWeZBz6sAWBgylBc8arUnyut0tWpK8rAGzimJXlaJHlCXcIByqFLsV7L8qHRB0t0Sds_-OSFS5IPpEMuJNeTDHM Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: a7a885b9c1574a8eb0a62b5253c9f8c2 Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1346650035 Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:18:54.892595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a7a885b9c1574a8eb0a62b5253c9f8c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a7a885b9c1574a8eb0a62b5253c9f8c2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a7a885b9c1574a8eb0a62b5253c9f8c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a7a885b9c1574a8eb0a62b5253c9f8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesSnapshotTestJSON-1346650035 Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: a7a885b9c1574a8eb0a62b5253c9f8c2 Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1346650035 Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesSnapshotTestJSON-1346650035-project Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 6ae6453ca9ec4a4eb3ec2e25900810cc Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesSnapshotTestJSON-1346650035-project Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 could not be found. Aug 08 18:18:54.894313 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '1e293101-e85f-4f50-a9ec-b8a174b6b1f4'} Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 could not be found. Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:18:54.896114 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 could not be found. Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 could not be found. Aug 08 18:18:54.897753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:18:54.899157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Returning 404 to user: Instance 1e293101-e85f-4f50-a9ec-b8a174b6b1f4 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:18:54.899157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a1056b3e-8096-4ffb-b229-61ee198ffe7c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4" status: 404 len: 111 microversion: 2.1 time: 0.029805 Aug 08 18:18:54.899157 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 561/1087] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:18:54 2022] GET /compute/v2.1/servers/1e293101-e85f-4f50-a9ec-b8a174b6b1f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:19:02.754863 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:19:02.755514 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Mon Aug 8 18:19:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:19:07.390902 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2028259354", "imageRef": "edec38f8-bf08-49f4-aae5-c95046596279", "flavorRef": "452", "networks": [{"uuid": "56f79f43-23fc-4ba0-a230-01eab48112f9"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:07.400232 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:07.400921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:07.448946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] validate_networks() for [('56f79f43-23fc-4ba0-a230-01eab48112f9', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:19:07.813089 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:19:07.813517 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:19:07.813993 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:19:07.814406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:19:07.815440 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:19:07.824269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:07.824793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:07.825244 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:07.825965 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:07.826430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:07.826857 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:07.843511 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Getting quotas for project a7a885b9c1574a8eb0a62b5253c9f8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:19:07.847720 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Getting quotas for user 6ae6453ca9ec4a4eb3ec2e25900810cc and project a7a885b9c1574a8eb0a62b5253c9f8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:19:07.858742 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:19:07.860998 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='edec38f8-bf08-49f4-aae5-c95046596279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:19:08.036493 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dc09d969-7b71-44d9-97bc-37ef638859a3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649455 Aug 08 18:19:08.036493 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 527/1088] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:19:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:19:08.049032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-409caf34-4753-4b63-817d-2995a0b52844 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:08.049790 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-409caf34-4753-4b63-817d-2995a0b52844 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:08.055566 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=8 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:08.056314 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:08.164932 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-409caf34-4753-4b63-817d-2995a0b52844 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:08.175263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-409caf34-4753-4b63-817d-2995a0b52844 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1219 microversion: 2.1 time: 0.126760 Aug 08 18:19:08.175263 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 562/1089] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:08 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:09.192753 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:09.193313 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:09.199460 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:09.212713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:09.212713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:09.212713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:09.212713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:09.213672 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:09.265161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:09.273072 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9da39f5c-a054-4887-98f8-3c3e6c5135c3 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1223 microversion: 2.1 time: 0.085342 Aug 08 18:19:09.273627 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 528/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:09 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:10.294724 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:10.295386 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:10.303966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:10.304458 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:10.304923 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:10.305624 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:10.306085 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:10.306644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:10.378120 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:10.386126 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6c3e7684-8153-40a7-b019-6e66a6b4089e tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1279 microversion: 2.1 time: 0.095287 Aug 08 18:19:10.392714 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 563/1091] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:10 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:11.407061 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:11.407678 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:11.414007 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:11.414489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:11.414933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:11.415624 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:11.416075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:11.416495 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:11.611336 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:11.619282 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e3cd9092-4d24-4788-8992-b671af1ac45b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.216280 Aug 08 18:19:11.619851 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 529/1092] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:11 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:11.996740 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-66718776-1bd6-4346-b41c-7ecb1c1f9f9e req-3f8950e8-8b37-441f-a6e0-6997a564b25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a9d0b44-36f7-4181-913d-b44267f92700", "tag": "c1ce6005-f875-420f-a180-01b3a4e06a32"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:12.008801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-66718776-1bd6-4346-b41c-7ecb1c1f9f9e req-3f8950e8-8b37-441f-a6e0-6997a564b25e service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:12.009538 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-66718776-1bd6-4346-b41c-7ecb1c1f9f9e req-3f8950e8-8b37-441f-a6e0-6997a564b25e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:12.009970 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-66718776-1bd6-4346-b41c-7ecb1c1f9f9e req-3f8950e8-8b37-441f-a6e0-6997a564b25e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:12.023623 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-66718776-1bd6-4346-b41c-7ecb1c1f9f9e req-3f8950e8-8b37-441f-a6e0-6997a564b25e service nova] Creating event network-changed:c1ce6005-f875-420f-a180-01b3a4e06a32 for instance 2a9d0b44-36f7-4181-913d-b44267f92700 on hv-cinder-85236 Aug 08 18:19:12.029033 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-66718776-1bd6-4346-b41c-7ecb1c1f9f9e req-3f8950e8-8b37-441f-a6e0-6997a564b25e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036618 Aug 08 18:19:12.029622 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 564/1093] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:19:12.641047 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:12.641658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:12.648458 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:12.649062 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:12.649557 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:12.650317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:12.650837 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:12.651322 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:12.838499 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:12.846187 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-28a25ad0-71cf-4eac-8dc6-ec5b858aa291 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.209436 Aug 08 18:19:12.856240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 530/1094] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:12 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:13.875457 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:13.876293 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:13.883133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:13.883617 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:13.884051 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:13.884769 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:13.885237 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:13.885662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:14.012138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:14.019554 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-8c32ca40-1fdf-438c-a914-9c72b0dc4d08 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.148754 Aug 08 18:19:14.020117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 565/1095] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:13 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:15.040000 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:15.040640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:15.047050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:15.047533 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:15.047969 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:15.048694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:15.049156 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:15.049581 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:15.176214 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:15.183582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5e651792-bf51-46a1-a4ab-a4a87ef64cc5 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.147492 Aug 08 18:19:15.184146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 531/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:15 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:16.204863 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:16.205990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:16.212214 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:16.215985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:16.215985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:16.215985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:16.215985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:16.216415 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:16.345201 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:16.353845 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-72175cca-4bf2-4aad-812b-492b2b824917 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.153128 Aug 08 18:19:16.354414 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 566/1097] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:16 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:17.377540 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:17.378317 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:17.384537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:17.385029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:17.385457 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:17.386175 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:17.386622 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:17.387037 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:17.527095 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:17.535964 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1106e6c9-13c3-4d47-a1f9-d9853b0ab257 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.165347 Aug 08 18:19:17.536769 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 532/1098] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:17 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:17.965659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:17.966213 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:17.973121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:17.973594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:17.974021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:17.974701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:17.975147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:17.975565 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:18.002502 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Going to try to terminate instance {{(pid=118382) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:19:18.169838 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:18.344347 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0169a71b-ba35-4650-8d8c-35699aef0ecb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 204 len: 0 microversion: 2.1 time: 0.382209 Aug 08 18:19:18.345001 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 567/1099] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:19:17 2022] DELETE /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:19:18.353477 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:18.354294 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:18.356217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:18.356900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:18.361569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:18.362053 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:18.362485 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:18.363224 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:18.363681 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:18.364126 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:18.495838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:18.503362 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-90ab1798-9bce-4de1-82c2-390936567862 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1575 microversion: 2.1 time: 0.153718 Aug 08 18:19:18.503921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 533/1100] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:18 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:18.557378 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:18.558103 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:18.564043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:18.564550 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:18.564996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:18.565672 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:18.566117 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:18.566534 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:18.694080 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:18.701311 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c91cbb51-f88e-458e-91f6-68376f1e3f73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.148038 Aug 08 18:19:18.701863 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 568/1101] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:18 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:19.523728 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:19.524337 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:19.530700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:19.531179 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:19.531613 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:19.532303 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:19.532782 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:19.533205 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:19.668843 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:19.677082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c8688302-a44f-4e1e-9495-07d422f8eaea tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1575 microversion: 2.1 time: 0.157274 Aug 08 18:19:19.677658 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 534/1102] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:19 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:19.722149 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:19.722754 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:19.729133 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:19.729631 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:19.730062 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:19.730733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:19.731178 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:19.731594 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:19.859037 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:19.866344 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-374064e0-ce59-4959-b358-f089b96d2d40 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.148554 Aug 08 18:19:19.866905 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 569/1103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:19 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:20.698580 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:20.699242 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:20.705947 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:20.706440 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:20.706881 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:20.707586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:20.708048 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:20.708770 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:20.841358 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:20.848871 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-93af4a25-02bc-445c-a262-4198c45c603d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1575 microversion: 2.1 time: 0.154532 Aug 08 18:19:20.849445 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 535/1104] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:20 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:20.886610 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:20.887229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:20.893602 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:20.894163 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:20.894608 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:20.895305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:20.895765 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:20.896192 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:21.027533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:21.035596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7173e894-b13c-4ee8-a545-9fbf57147645 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.152747 Aug 08 18:19:21.036161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 570/1105] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:20 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:21.855098 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-923d9e25-0008-4c06-9e6c-0e97c6a64f5c req-1f6b92ea-cb94-473b-b81c-291796d47cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9d0b44-36f7-4181-913d-b44267f92700", "name": "network-vif-plugged", "status": "completed", "tag": "c1ce6005-f875-420f-a180-01b3a4e06a32"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:21.869933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-923d9e25-0008-4c06-9e6c-0e97c6a64f5c req-1f6b92ea-cb94-473b-b81c-291796d47cec service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:21.869933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-923d9e25-0008-4c06-9e6c-0e97c6a64f5c req-1f6b92ea-cb94-473b-b81c-291796d47cec service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:21.869933 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-923d9e25-0008-4c06-9e6c-0e97c6a64f5c req-1f6b92ea-cb94-473b-b81c-291796d47cec service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:21.875254 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:21.875881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:21.879724 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-923d9e25-0008-4c06-9e6c-0e97c6a64f5c req-1f6b92ea-cb94-473b-b81c-291796d47cec service nova] Creating event network-vif-plugged:c1ce6005-f875-420f-a180-01b3a4e06a32 for instance 2a9d0b44-36f7-4181-913d-b44267f92700 on hv-cinder-85236 Aug 08 18:19:21.882717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:21.883745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:21.883745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:21.884965 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:21.885296 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:21.885415 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-923d9e25-0008-4c06-9e6c-0e97c6a64f5c req-1f6b92ea-cb94-473b-b81c-291796d47cec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034131 Aug 08 18:19:21.885696 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:21.891090 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 536/1106] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:19:22.023553 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:22.034522 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-58fef727-d84d-4264-9b70-06745751a43c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1575 microversion: 2.1 time: 0.163574 Aug 08 18:19:22.035122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 571/1107] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:21 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:22.056464 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:22.057225 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:22.065458 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:22.066006 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:22.066466 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:22.067223 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:22.067684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:22.068270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:22.286190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:22.294695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4a88df7d-e827-4e58-918d-0af717642e68 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.242707 Aug 08 18:19:22.296796 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 537/1108] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:22 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:23.055810 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:23.056433 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:23.063488 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:23.063975 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:23.064407 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:23.065147 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:23.065781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:23.066349 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:23.167185 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:23.175650 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-c2745c00-f53d-40e6-918a-08ae3dcd71bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1508 microversion: 2.1 time: 0.124206 Aug 08 18:19:23.176265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 572/1109] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:23 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1508 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:23.288064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-e1311cc1-a3f1-4c68-b6b8-78b21c68435f req-773aef54-d466-48e8-b052-0b72a670afe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6363da42-8d2d-4e98-aabc-46fa6ca81bd7", "name": "network-vif-deleted", "tag": "36e7c598-8df4-41e7-a656-c49754941c21"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:23.297877 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e1311cc1-a3f1-4c68-b6b8-78b21c68435f req-773aef54-d466-48e8-b052-0b72a670afe4 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:23.298475 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e1311cc1-a3f1-4c68-b6b8-78b21c68435f req-773aef54-d466-48e8-b052-0b72a670afe4 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:23.298941 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e1311cc1-a3f1-4c68-b6b8-78b21c68435f req-773aef54-d466-48e8-b052-0b72a670afe4 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:23.310733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-e1311cc1-a3f1-4c68-b6b8-78b21c68435f req-773aef54-d466-48e8-b052-0b72a670afe4 service nova] Creating event network-vif-deleted:36e7c598-8df4-41e7-a656-c49754941c21 for instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 on hv-cinder-85236 Aug 08 18:19:23.316312 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-e1311cc1-a3f1-4c68-b6b8-78b21c68435f req-773aef54-d466-48e8-b052-0b72a670afe4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 Aug 08 18:19:23.317253 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 538/1110] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:19:23.317831 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:23.318458 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:23.324375 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:23.324894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:23.325332 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:23.326208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:23.326667 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:23.327092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:23.456251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:23.463985 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-55cc94ad-9b9a-4f83-af4e-9e65721670ff tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.151941 Aug 08 18:19:23.464600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 573/1111] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:23 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:24.198213 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:24.198924 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:24.205134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:24.205603 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:24.206045 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:24.206947 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:24.207414 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:24.207847 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:24.273535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:24.281241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9db2c268-9980-45a8-aa78-06dee176326e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1508 microversion: 2.1 time: 0.087338 Aug 08 18:19:24.281809 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 539/1112] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:24 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1508 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:24.484804 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:24.485340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:24.491787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:24.492273 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:24.492743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:24.493437 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:24.493889 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:24.494312 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:24.622945 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:24.630269 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-39f2b955-920f-4c99-bbad-a51427e97f70 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.149702 Aug 08 18:19:24.630841 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 574/1113] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:24 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:25.303101 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:25.303861 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:25.310560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:25.311079 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:25.311546 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:25.312313 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:25.312810 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:25.313240 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:25.376146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:25.384147 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1f711c50-da90-412a-bba4-d0f95e46a0c7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1224 microversion: 2.1 time: 0.085399 Aug 08 18:19:25.384738 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 540/1114] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:25 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:25.651063 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:25.651609 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:25.657940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:25.658908 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:25.659340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:25.660039 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:25.660474 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:25.660920 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:25.791265 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:25.798711 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-97542a61-f1be-4616-8505-525ab22daf11 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1319 microversion: 2.1 time: 0.151542 Aug 08 18:19:25.799258 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 575/1115] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:25 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:26.404051 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:26.404813 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:26.414395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:26.414395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:26.414395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:26.414395 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:26.414733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:26.414733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:26.446901 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:26.447383 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:26.447820 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:26.448270 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lazy-loading 'fault' on Instance uuid 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:19:26.491269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:26.498898 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5b826fde-76af-4a25-bdc9-92664c8f7fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 200 len: 1229 microversion: 2.1 time: 0.098712 Aug 08 18:19:26.499455 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 541/1116] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:26 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:26.819613 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:26.820228 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:26.827723 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:26.828387 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:26.828857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:26.829589 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:26.830064 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:26.830487 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:26.962003 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:26.969599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-6ed6b829-c67e-438b-9f01-ea865165968b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1509 microversion: 2.1 time: 0.153982 Aug 08 18:19:26.970169 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 576/1117] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:26 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:26.991821 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3b0fbec-18b2-45f8-b224-c0e917dbb104", "device": "/dev/sdb"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:26.994751 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:27.000586 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:27.001102 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:27.001653 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:27.003798 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:27.004284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:27.004816 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:27.519656 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:27.520305 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:27.526297 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:27.526781 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:27.527227 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:27.527918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:27.528376 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:27.528834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:27.542873 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] HTTP exception thrown: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Request method failure captured: Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 HTTP/1.1 Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VLjj26Qss66Ads88BtWxkPY8_leDzU1JED4xQXsstmsx3yesASysTT0EAqhrU1NGrosg56E8-e6WH7ZntzI47ZsZ7h0eOCSt53SOVUr1ZZp9n9QhrBjP0jASVsHoHxwlJNKl66CpHu7J-FczxcbvC4s2ao58hAR5AsaDujo8WNn7A4 Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:19:27.544521 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c98de54846de4169b0ea5cca7aae3cf0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-TestVolumeBootPattern-73603540 Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 0c911d938fd64f25844903809d56b263 Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:19:27.546280 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '6363da42-8d2d-4e98-aabc-46fa6ca81bd7'} Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:19:27.547176 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:19:27.548894 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:27.550580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Returning 404 to user: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:19:27.550580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4db338b6-4449-4c34-a0b6-c8a43d28e988 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 404 len: 111 microversion: 2.1 time: 0.030715 Aug 08 18:19:27.550580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 577/1118] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:27 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 18:19:27.642055 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-447078085", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-605769720", "security_groups": [{"name": "tempest-secgroup-smoke-679493763"}], "block_device_mapping_v2": [{"uuid": "fda60e56-e820-43df-a4a4-050e67bbca12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "977b81f6-64f9-443a-bb92-2dc33e37e639"}]}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:27.757575 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] validate_networks() for [('977b81f6-64f9-443a-bb92-2dc33e37e639', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:19:27.822487 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7543322b-f750-4b22-ae70-ebe0b4faf9e4 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "POST /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834714 Aug 08 18:19:27.823034 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 542/1119] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Aug 8 18:19:26 2022] POST /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:19:28.145089 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:19:28.145579 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:19:28.145968 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:19:28.146371 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:19:28.146780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:19:28.155729 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:28.156205 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:28.156682 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:28.157404 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:28.157857 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:28.158319 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:28.175505 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Getting quotas for project c98de54846de4169b0ea5cca7aae3cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:19:28.180755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Getting quotas for user 0c911d938fd64f25844903809d56b263 and project c98de54846de4169b0ea5cca7aae3cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:19:28.246090 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:19:28.248168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fda60e56-e820-43df-a4a4-050e67bbca12',volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:19:28.652242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-74603385-32c8-4d43-a90a-b0bc1914f9b2 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.014023 Aug 08 18:19:28.653046 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 578/1120] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:19:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 18:19:28.666071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-963135e1-f7e1-441d-9a82-67d98495b6e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:28.667730 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-963135e1-f7e1-441d-9a82-67d98495b6e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:28.727043 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-963135e1-f7e1-441d-9a82-67d98495b6e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:28.734082 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-963135e1-f7e1-441d-9a82-67d98495b6e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1093 microversion: 2.1 time: 0.073184 Aug 08 18:19:28.734695 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 543/1121] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:28 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:29.759569 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:29.760174 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:29.766876 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:29.767398 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:29.768659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:29.768659 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:29.769046 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:29.769519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:29.831449 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:29.835346 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:29.839680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1fc9e7a1-2185-4cce-95f3-55829553a2cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1143 microversion: 2.1 time: 0.084605 Aug 08 18:19:29.840238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 579/1122] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:29 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:30.861201 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:30.861961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:30.870560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:30.871145 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:30.871825 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:30.872618 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:30.873152 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:30.873684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:30.950490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:30.954175 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:30.958846 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a52c29ed-352b-4306-b69d-3a85b517ec23 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1199 microversion: 2.1 time: 0.101523 Aug 08 18:19:30.964419 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 544/1123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:30 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:31.983020 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:31.983782 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:31.991238 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:31.991726 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:31.992162 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:31.992900 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:31.993384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:31.993812 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:32.186823 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:32.194246 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2bade2fe-39db-4473-9f31-23ef3a375baa tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1276 microversion: 2.1 time: 0.216891 Aug 08 18:19:32.194813 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 580/1124] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:31 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:32.636284 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-411ac7a0-ec7d-419f-a7ed-c33b7bca3333 req-bc8072d4-6ef2-416c-b1cf-db99a01982f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379c3309-85bd-41f4-b4a3-c03c7e075a60", "tag": "a48dbaea-363d-462b-8e00-191b7241d241"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:32.646071 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-411ac7a0-ec7d-419f-a7ed-c33b7bca3333 req-bc8072d4-6ef2-416c-b1cf-db99a01982f3 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:32.646558 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-411ac7a0-ec7d-419f-a7ed-c33b7bca3333 req-bc8072d4-6ef2-416c-b1cf-db99a01982f3 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:32.646996 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-411ac7a0-ec7d-419f-a7ed-c33b7bca3333 req-bc8072d4-6ef2-416c-b1cf-db99a01982f3 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:32.657961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-411ac7a0-ec7d-419f-a7ed-c33b7bca3333 req-bc8072d4-6ef2-416c-b1cf-db99a01982f3 service nova] Creating event network-changed:a48dbaea-363d-462b-8e00-191b7241d241 for instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 on hv-cinder-85236 Aug 08 18:19:32.663120 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-411ac7a0-ec7d-419f-a7ed-c33b7bca3333 req-bc8072d4-6ef2-416c-b1cf-db99a01982f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151424 Aug 08 18:19:32.663705 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 545/1125] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:19:33.219384 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:33.220008 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:33.226502 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:33.226991 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:33.227433 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:33.228131 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:33.228618 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:33.229049 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:33.430078 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:33.437530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-04942829-872e-4aad-8956-698b2fd4fd63 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1276 microversion: 2.1 time: 0.222180 Aug 08 18:19:33.438287 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 581/1126] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:33 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:34.460271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:34.461021 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:34.468029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:34.468582 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:34.468963 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:34.469651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:34.470105 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:34.470530 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:34.600135 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:34.607552 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8e6593d9-bd76-4952-a069-f12e7a9dd9fc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1276 microversion: 2.1 time: 0.152971 Aug 08 18:19:34.612162 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 546/1127] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:34 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:35.629257 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:35.630197 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:35.636207 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:35.636733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:35.637168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:35.637853 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:35.638435 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:35.638895 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:35.777068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:35.785387 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-1a3d229b-f4d1-48f5-a3ce-1c8fb89282bc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1276 microversion: 2.1 time: 0.159643 Aug 08 18:19:35.785989 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 582/1128] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:35 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:36.379631 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:19:36.380208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Mon Aug 8 18:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:19:36.806752 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:36.807411 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:36.813936 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:36.814459 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:36.814903 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:36.815602 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:36.816064 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:36.816494 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:36.946496 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:36.954125 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8bb17ca2-8a1c-4d54-8292-2eb2b7abfd37 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1276 microversion: 2.1 time: 0.151221 Aug 08 18:19:36.954827 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 547/1129] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:36 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:37.975327 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:37.975871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:37.982285 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:37.982764 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:37.983194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:37.983889 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:37.984338 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:37.984797 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:38.119104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:38.126852 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-292451df-d66c-49b8-bf33-18481b5d2753 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1276 microversion: 2.1 time: 0.155556 Aug 08 18:19:38.127415 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 583/1130] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:37 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:39.148927 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:39.149548 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:39.151939 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:39.152634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:39.157222 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:39.157708 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:39.158146 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:39.158840 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:39.159298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:39.159733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:39.290744 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:39.298226 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dc1c1048-9667-4e66-95f4-fe1114bb4d69 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.154038 Aug 08 18:19:39.298791 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 548/1131] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:39 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:40.319477 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:40.320310 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:40.322208 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:40.322886 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=6 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:40.323978 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:19:40.328741 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:40.330142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:40.330142 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:40.330471 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:40.330927 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:40.331352 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:40.461295 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:40.468656 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-efeebe78-6f22-42c9-94d8-14ed3180281b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.153371 Aug 08 18:19:40.469222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 584/1132] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:40 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:41.490767 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:41.491302 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:41.498127 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:41.498614 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:41.499050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:41.499737 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:41.500190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:41.500644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:41.630177 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:41.637593 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-96b07843-b865-4777-a3ea-e779eed2cba3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.151405 Aug 08 18:19:41.638155 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 549/1133] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:41 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:42.658773 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:42.659377 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:42.666517 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:42.666990 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:42.667416 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:42.668092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:42.668563 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:42.669032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:42.806328 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:42.814393 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-4c84d9c1-99ef-41a8-88fa-1b035cdcebfe tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.159811 Aug 08 18:19:42.814962 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 585/1134] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:42 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:43.835258 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:43.835876 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:43.842369 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:43.842859 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:43.843300 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:43.843997 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:43.844458 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:43.844909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:43.976286 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:43.983734 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cb4c679e-bd96-45c1-8bd4-bdbff1134fe7 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.152636 Aug 08 18:19:43.984285 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 550/1135] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:43 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:45.005329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:45.005946 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:45.012605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:45.013094 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:45.013533 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:45.014221 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:45.014677 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:45.015095 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:45.144680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:45.151512 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f0f8b1d5-915a-4846-ae81-378c6fc67d8e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.150649 Aug 08 18:19:45.152077 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 586/1136] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:44 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:46.172458 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:46.173040 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:46.180017 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:46.180513 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:46.180972 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:46.181660 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:46.182117 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:46.182543 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:46.310254 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:46.318165 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-eebbc835-b8a5-4742-8b98-dc87adb3c4ee tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.149829 Aug 08 18:19:46.318723 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 551/1137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:46 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:47.339123 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:47.339735 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:47.345884 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:47.346438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:47.346999 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:47.347698 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:47.348150 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:47.348605 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:47.483101 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:47.491122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-56086b69-ec52-4bb6-bc71-91f260f5a9ad tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.155965 Aug 08 18:19:47.491686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 587/1138] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:47 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:47.809760 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:47.810259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:47.817717 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:47.818208 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:47.818657 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:47.819359 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:47.819819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:47.820248 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:47.899378 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lazy-loading 'services' on Instance uuid 2a9d0b44-36f7-4181-913d-b44267f92700 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:19:48.136487 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-80a2da85-9969-44af-9015-250884ec95c1 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700/os-volume_attachments/a3b0fbec-18b2-45f8-b224-c0e917dbb104" status: 202 len: 0 microversion: 2.1 time: 0.330549 Aug 08 18:19:48.137130 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 552/1139] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Aug 8 18:19:47 2022] DELETE /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700/os-volume_attachments/a3b0fbec-18b2-45f8-b224-c0e917dbb104 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:19:48.512314 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:48.512909 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:48.519763 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:48.520243 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:48.520745 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:48.521431 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:48.521883 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:48.522304 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:48.650205 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:48.657549 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ec4da2e3-4981-4f8e-8a9e-41b588596848 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.149164 Aug 08 18:19:48.658136 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 588/1140] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:48 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:49.259942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:49.260605 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:49.266735 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:49.267300 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:49.267743 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:49.268451 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:49.268938 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:49.269363 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:49.297931 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:19:49.455380 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-a3d99ed7-3836-4de4-9bad-3d381fb1dc9c req-7bd26a07-982a-4d1a-978a-4975d81e23c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379c3309-85bd-41f4-b4a3-c03c7e075a60", "name": "network-vif-plugged", "status": "completed", "tag": "a48dbaea-363d-462b-8e00-191b7241d241"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:49.465000 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-a3d99ed7-3836-4de4-9bad-3d381fb1dc9c req-7bd26a07-982a-4d1a-978a-4975d81e23c3 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:49.465520 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-a3d99ed7-3836-4de4-9bad-3d381fb1dc9c req-7bd26a07-982a-4d1a-978a-4975d81e23c3 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:49.465953 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-a3d99ed7-3836-4de4-9bad-3d381fb1dc9c req-7bd26a07-982a-4d1a-978a-4975d81e23c3 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:49.478034 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-a3d99ed7-3836-4de4-9bad-3d381fb1dc9c req-7bd26a07-982a-4d1a-978a-4975d81e23c3 service nova] Creating event network-vif-plugged:a48dbaea-363d-462b-8e00-191b7241d241 for instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 on hv-cinder-85236 Aug 08 18:19:49.483242 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-a3d99ed7-3836-4de4-9bad-3d381fb1dc9c req-7bd26a07-982a-4d1a-978a-4975d81e23c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147953 Aug 08 18:19:49.483832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 589/1141] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:19:49.652715 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b69ab7ff-b35f-45c5-832c-21c51ab1850c tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 204 len: 0 microversion: 2.1 time: 0.397176 Aug 08 18:19:49.653448 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 553/1142] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:19:49 2022] DELETE /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:19:49.662597 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:49.663524 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:49.669869 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:49.670345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:49.670800 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:49.671452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:49.671924 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:49.672383 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:49.678684 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:49.679463 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:49.685481 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:49.691103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:49.691103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:49.691103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:49.691103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:49.691450 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:49.881530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:49.884811 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:49.889179 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-98cf54cd-17a3-44d6-93fc-5bccd730266b tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1515 microversion: 2.1 time: 0.231454 Aug 08 18:19:49.891581 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 590/1143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:49 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:49.892528 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5ebde58e-a15a-4883-abbc-758274e04a19 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.218794 Aug 08 18:19:49.893103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 554/1144] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:49 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:50.909067 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:50.909802 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:50.912520 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:50.913207 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:50.916423 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:50.916937 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:50.917370 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:50.918056 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:50.918507 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:50.918926 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:50.919474 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:50.919951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:50.920381 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:50.921250 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:50.921560 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:50.921974 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:51.148489 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:51.153423 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:51.157002 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-685666aa-631b-4a44-b8cf-a7bff787ac6d tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1515 microversion: 2.1 time: 0.251698 Aug 08 18:19:51.157832 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 591/1145] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:50 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:51.160937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-137f5fdb-866b-4d39-8150-3b577bc2b8fb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.252178 Aug 08 18:19:51.161504 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 555/1146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:50 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:52.177591 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:52.178357 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:52.181984 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:52.182604 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:52.185184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:52.185743 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:52.186251 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:52.186953 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:52.187405 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:52.187828 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:52.189316 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:52.189811 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:52.190256 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:52.190968 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:52.191430 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:52.191856 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:52.478951 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:52.487836 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:52.494957 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-0af1fc4a-fb37-4932-a591-b12d529919fc tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1515 microversion: 2.1 time: 0.321208 Aug 08 18:19:52.504687 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 592/1147] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:52 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:52.504885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-459e8dbd-f181-44de-9903-d3e52f843d68 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1264 microversion: 2.1 time: 0.321910 Aug 08 18:19:52.504885 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 556/1148] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:52 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1264 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:53.019270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-f1e29ba5-4956-4045-9075-5b17724a3d33 req-d15659e6-e32b-44de-a0e7-9cb932d1cc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9d0b44-36f7-4181-913d-b44267f92700", "name": "network-vif-deleted", "tag": "c1ce6005-f875-420f-a180-01b3a4e06a32"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:53.028791 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f1e29ba5-4956-4045-9075-5b17724a3d33 req-d15659e6-e32b-44de-a0e7-9cb932d1cc60 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:53.034922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f1e29ba5-4956-4045-9075-5b17724a3d33 req-d15659e6-e32b-44de-a0e7-9cb932d1cc60 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:53.034922 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-f1e29ba5-4956-4045-9075-5b17724a3d33 req-d15659e6-e32b-44de-a0e7-9cb932d1cc60 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:53.040497 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-f1e29ba5-4956-4045-9075-5b17724a3d33 req-d15659e6-e32b-44de-a0e7-9cb932d1cc60 service nova] Creating event network-vif-deleted:c1ce6005-f875-420f-a180-01b3a4e06a32 for instance 2a9d0b44-36f7-4181-913d-b44267f92700 on hv-cinder-85236 Aug 08 18:19:53.045439 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-f1e29ba5-4956-4045-9075-5b17724a3d33 req-d15659e6-e32b-44de-a0e7-9cb932d1cc60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029894 Aug 08 18:19:53.046145 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 593/1149] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:19:53.517282 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:53.517887 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:53.521424 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:53.522126 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:53.525014 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:53.525504 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:53.525942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:53.526640 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:53.527107 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:53.527535 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:53.528733 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:53.529241 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:53.529644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:53.530327 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:53.530780 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:53.531200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:53.558331 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:53.558819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:53.559262 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:53.559713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lazy-loading 'fault' on Instance uuid 2a9d0b44-36f7-4181-913d-b44267f92700 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:19:53.621247 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6453ca9ec4a4eb3ec2e25900810cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a885b9c1574a8eb0a62b5253c9f8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:53.629075 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4ab69d7a-44ba-417b-b84d-969ef5f75c73 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 200 len: 1309 microversion: 2.1 time: 0.115636 Aug 08 18:19:53.629874 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 557/1150] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:53 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:53.690032 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:53.697678 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-16db7a3d-1839-44fb-a505-671da110ba74 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1450 microversion: 2.1 time: 0.180932 Aug 08 18:19:53.700530 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 594/1151] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:53 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 18:19:53.721866 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:53.722537 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:53.729169 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:53.729665 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:53.730103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:53.730788 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:53.731235 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:53.731651 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:53.867925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:19:53.877060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f52565e2-08e8-4dfb-8f71-0bbbfd173f64 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1450 microversion: 2.1 time: 0.161598 Aug 08 18:19:53.877689 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 558/1152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:53 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:19:54.649753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:19:54.650355 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] [instance: 2a9d0b44-36f7-4181-913d-b44267f92700] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:19:54.657029 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:54.657452 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:54.657889 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:54.658600 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:54.659062 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:54.659978 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:54.673350 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] HTTP exception thrown: Instance 2a9d0b44-36f7-4181-913d-b44267f92700 could not be found. Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Request method failure captured: Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 HTTP/1.1 Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VNBqQnpnrNPF_wTYg4WVv-B1n9fEY6XzoUeoNNy3XcoFku6L9RRZCl-idI6lFT75UfEz7dA7ayrj9rqEFRSTUB3aWeZBz6sAWBgylBc8arUnyut0tWpK8rAGzimJXlaJHlCXcIByqFLsV7L8qHRB0t0Sds_-OSFS5IPpEMuJNeTDHM Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: a7a885b9c1574a8eb0a62b5253c9f8c2 Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1346650035 Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:19:54.675544 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a7a885b9c1574a8eb0a62b5253c9f8c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a7a885b9c1574a8eb0a62b5253c9f8c2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a7a885b9c1574a8eb0a62b5253c9f8c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a7a885b9c1574a8eb0a62b5253c9f8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-VolumesSnapshotTestJSON-1346650035 Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: a7a885b9c1574a8eb0a62b5253c9f8c2 Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1346650035 Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-VolumesSnapshotTestJSON-1346650035-project Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 6ae6453ca9ec4a4eb3ec2e25900810cc Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-VolumesSnapshotTestJSON-1346650035-project Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 2a9d0b44-36f7-4181-913d-b44267f92700 could not be found. Aug 08 18:19:54.677323 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '2a9d0b44-36f7-4181-913d-b44267f92700'} Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a9d0b44-36f7-4181-913d-b44267f92700 could not be found. Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:19:54.678288 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a9d0b44-36f7-4181-913d-b44267f92700 could not be found. Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a9d0b44-36f7-4181-913d-b44267f92700 could not be found. Aug 08 18:19:54.679940 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:19:54.681267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] Returning 404 to user: Instance 2a9d0b44-36f7-4181-913d-b44267f92700 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:19:54.681267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7fc7969d-fb46-41fa-becc-c979a1fb6158 tempest-VolumesSnapshotTestJSON-1346650035 tempest-VolumesSnapshotTestJSON-1346650035-project] 10.222.0.50 "GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700" status: 404 len: 111 microversion: 2.1 time: 0.031116 Aug 08 18:19:54.681267 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 595/1153] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:19:54 2022] GET /compute/v2.1/servers/2a9d0b44-36f7-4181-913d-b44267f92700 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:19:55.837770 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-7ab4b3e8-07f8-4396-a172-815cd3604a84 req-7a9e37a6-00a1-4bad-9ff9-9b8ab8008805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379c3309-85bd-41f4-b4a3-c03c7e075a60", "tag": "a48dbaea-363d-462b-8e00-191b7241d241"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:19:55.848277 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7ab4b3e8-07f8-4396-a172-815cd3604a84 req-7a9e37a6-00a1-4bad-9ff9-9b8ab8008805 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:19:55.848713 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7ab4b3e8-07f8-4396-a172-815cd3604a84 req-7a9e37a6-00a1-4bad-9ff9-9b8ab8008805 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:19:55.849149 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7ab4b3e8-07f8-4396-a172-815cd3604a84 req-7a9e37a6-00a1-4bad-9ff9-9b8ab8008805 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:19:55.862937 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-7ab4b3e8-07f8-4396-a172-815cd3604a84 req-7a9e37a6-00a1-4bad-9ff9-9b8ab8008805 service nova] Creating event network-changed:a48dbaea-363d-462b-8e00-191b7241d241 for instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 on hv-cinder-85236 Aug 08 18:19:55.868120 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-7ab4b3e8-07f8-4396-a172-815cd3604a84 req-7a9e37a6-00a1-4bad-9ff9-9b8ab8008805 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034304 Aug 08 18:19:55.868691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 559/1154] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:21:43.376580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=23 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:21:43.377338 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=84 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:21:43.381840 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-741127891", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-605769720", "security_groups": [{"name": "tempest-secgroup-smoke-679493763"}], "block_device_mapping_v2": [{"uuid": "35bdb858-5284-476a-ae9e-4b828d86b74c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "977b81f6-64f9-443a-bb92-2dc33e37e639"}]}} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:21:43.494871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.network.neutron [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] validate_networks() for [('977b81f6-64f9-443a-bb92-2dc33e37e639', None, None, None, None, None)] {{(pid=118382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 18:21:43.951551 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Flavor limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 18:21:43.951978 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Image limits 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 18:21:43.952479 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Flavor pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 18:21:43.952918 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Image pref 0:0:0 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 18:21:43.953329 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.virt.hardware [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 18:21:43.962248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:43.962725 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:43.963159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:43.963890 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:43.964345 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:43.964800 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:43.982934 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Getting quotas for project c98de54846de4169b0ea5cca7aae3cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 18:21:43.986879 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.quota [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Getting quotas for user 0c911d938fd64f25844903809d56b263 and project c98de54846de4169b0ea5cca7aae3cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=118382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 18:21:44.042138 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Going to run 1 instances... {{(pid=118382) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 18:21:44.044198 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35bdb858-5284-476a-ae9e-4b828d86b74c',volume_size=None,volume_type=None)] {{(pid=118382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 18:21:44.395592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-688222b4-2a10-4e58-91fb-2e1d51352f54 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.020925 Aug 08 18:21:44.396230 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 596/1155] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Aug 8 18:21:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 18:21:44.406012 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db723886-f6af-48e7-813d-fd2c2a647068] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 08 18:21:44.406776 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:21:44.407638 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:21:44.412026 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e9b03c65-2ef6-4f84-a4ec-fe506a3f2aa8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:44.413569 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e9b03c65-2ef6-4f84-a4ec-fe506a3f2aa8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:44.467662 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e9b03c65-2ef6-4f84-a4ec-fe506a3f2aa8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:44.474390 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e9b03c65-2ef6-4f84-a4ec-fe506a3f2aa8 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1093 microversion: 2.1 time: 0.070392 Aug 08 18:21:44.475677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 560/1156] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:44 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:45.496900 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:45.497477 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:45.503540 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:45.504005 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:45.504475 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:45.505197 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:45.505658 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:45.506084 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:45.567537 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:45.575222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e1fe6e2c-4aac-490e-a594-2c6b51bf6b21 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1143 microversion: 2.1 time: 0.082891 Aug 08 18:21:45.576620 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 597/1157] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:45 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:46.595685 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:46.596311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:46.607326 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:46.609628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:46.609628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:46.609628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:46.609628 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:46.610009 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:46.616195 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] [db723886-f6af-48e7-813d-fd2c2a647068] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34120. Aug 08 18:21:46.729900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:46.737670 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-81c5d13b-2b41-48aa-8e7c-da4642590348 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1209 microversion: 2.1 time: 0.146238 Aug 08 18:21:46.738230 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 561/1158] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:46 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:47.758808 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:47.759434 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:47.765803 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:47.766289 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:47.766761 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:47.767680 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:47.768134 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:47.768578 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:47.977736 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:47.989801 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-a9f43811-021c-464b-a842-739f698ed1eb tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1276 microversion: 2.1 time: 0.234754 Aug 08 18:21:47.990439 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 598/1159] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:47 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:48.337055 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-ee0a1803-3a2f-439a-be28-7570e8888403 req-053d9fcd-95ab-42e3-91ae-9b0501305bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e97e6e-e763-4415-83be-ae99380cfca9", "tag": "af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:21:48.346929 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ee0a1803-3a2f-439a-be28-7570e8888403 req-053d9fcd-95ab-42e3-91ae-9b0501305bf3 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:48.347410 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ee0a1803-3a2f-439a-be28-7570e8888403 req-053d9fcd-95ab-42e3-91ae-9b0501305bf3 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:48.347844 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ee0a1803-3a2f-439a-be28-7570e8888403 req-053d9fcd-95ab-42e3-91ae-9b0501305bf3 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:48.359406 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-ee0a1803-3a2f-439a-be28-7570e8888403 req-053d9fcd-95ab-42e3-91ae-9b0501305bf3 service nova] Creating event network-changed:af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711 for instance 93e97e6e-e763-4415-83be-ae99380cfca9 on hv-cinder-85236 Aug 08 18:21:48.364368 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-ee0a1803-3a2f-439a-be28-7570e8888403 req-053d9fcd-95ab-42e3-91ae-9b0501305bf3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032023 Aug 08 18:21:48.364991 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 562/1160] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:21:49.010875 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:49.011510 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:49.017864 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:49.018336 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:49.018759 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:49.019651 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:49.020099 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:49.020535 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:49.179314 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:49.185296 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-245080bb-71eb-4c4b-a5d5-4f13fb705064 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.178311 Aug 08 18:21:49.185867 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 599/1161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:49 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:50.208046 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:50.208680 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:50.216038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:50.216551 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:50.217119 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:50.217831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:50.218298 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:50.218728 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:50.346381 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:50.354851 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7b406ef1-ea54-4b93-a71b-94a376cd74ef tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.151500 Aug 08 18:21:50.355426 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 563/1162] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:50 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:51.375325 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:51.375966 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:51.382947 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:51.383426 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:51.383860 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:51.384564 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:51.385017 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:51.385438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:51.517662 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:51.525168 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-20d5c6d2-e2ed-4e92-8252-35a03808ef49 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.153720 Aug 08 18:21:51.525739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 600/1163] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:51 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:52.546320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:52.546934 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:52.553398 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:52.553883 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:52.554320 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:52.555013 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:52.555467 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:52.555892 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:52.683899 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:52.691232 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9c757ebb-6bc5-494a-9bd9-319c3c285a03 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.148814 Aug 08 18:21:52.691791 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 564/1164] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:52 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:53.712096 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:53.712739 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:53.719159 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:53.719637 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:53.720068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:53.720772 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:53.721222 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:53.721644 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:53.853866 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:53.861347 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-9370e96b-cbd0-459e-873a-11acc13e13f5 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.153970 Aug 08 18:21:53.863721 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 601/1165] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:53 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:54.882860 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:54.883489 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:54.885950 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:21:54.890663 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:54.891139 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:54.891596 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:54.892281 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:54.892769 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:54.893190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:55.027680 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:55.033464 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c2f523da-4b00-4a0b-b8bb-a8e5c64f0a0e tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.155086 Aug 08 18:21:55.034031 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 565/1166] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:54 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:56.054717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:56.055335 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:56.057184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=2 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:21:56.057856 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell0:SELECT=6 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:21:56.063030 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:56.068834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:56.068834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:56.068834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:56.068834 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:56.069229 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:56.201540 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:56.209076 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-7b63be3c-ebf4-4762-8544-953580fdecaf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.158801 Aug 08 18:21:56.209892 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 602/1167] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:56 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:57.230637 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:57.231269 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:57.237642 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:57.242402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:57.242402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:57.242402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:57.242402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:57.242819 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:57.373909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:57.382385 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fe8252ab-1999-42be-ad84-9b34c472159f tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.155662 Aug 08 18:21:57.385875 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 566/1168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:57 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:58.403047 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:58.403671 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:58.410073 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:58.410567 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:58.411000 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:58.412260 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:58.412755 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:58.413186 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:58.549777 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:58.557891 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e77198f6-701e-4a49-96cc-b3d7f45d75f3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.158832 Aug 08 18:21:58.558459 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 603/1169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:58 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:59.577946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:21:59.578563 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:21:59.585710 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:59.586193 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:59.586634 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:59.587328 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:21:59.587787 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:21:59.588215 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:21:59.720402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:21:59.727909 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-55acd4b9-0f1a-44a6-91d8-c11bbf40f3cf tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.153882 Aug 08 18:21:59.728478 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 567/1170] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:21:59 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:21:59.997248 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-d0cedebb-51f3-4c15-be5b-d047e9c3759a req-b961cc4d-4c69-4f70-99f2-383cbf269c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e97e6e-e763-4415-83be-ae99380cfca9", "name": "network-vif-plugged", "status": "completed", "tag": "af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:22:00.003641 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d0cedebb-51f3-4c15-be5b-d047e9c3759a req-b961cc4d-4c69-4f70-99f2-383cbf269c9e service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:22:00.004110 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d0cedebb-51f3-4c15-be5b-d047e9c3759a req-b961cc4d-4c69-4f70-99f2-383cbf269c9e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:22:00.004566 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-d0cedebb-51f3-4c15-be5b-d047e9c3759a req-b961cc4d-4c69-4f70-99f2-383cbf269c9e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:22:00.015881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-d0cedebb-51f3-4c15-be5b-d047e9c3759a req-b961cc4d-4c69-4f70-99f2-383cbf269c9e service nova] Creating event network-vif-plugged:af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711 for instance 93e97e6e-e763-4415-83be-ae99380cfca9 on hv-cinder-85236 Aug 08 18:22:00.020931 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-d0cedebb-51f3-4c15-be5b-d047e9c3759a req-b961cc4d-4c69-4f70-99f2-383cbf269c9e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030212 Aug 08 18:22:00.022075 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 604/1171] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:22:00.748538 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:22:00.749094 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:22:00.755516 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:22:00.756005 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:22:00.756443 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:22:00.757161 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:22:00.757614 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:22:00.758038 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:22:00.890979 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:22:00.899297 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-006fefa2-af68-4ae4-8bee-cf3badfb9c79 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1264 microversion: 2.1 time: 0.154617 Aug 08 18:22:00.900550 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 568/1172] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:22:00 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:22:01.921403 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:22:01.922092 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:22:01.928686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:22:01.929164 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:22:01.929593 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:22:01.930270 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:22:01.930717 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:22:01.931129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:22:02.067517 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:22:02.075021 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-f69065b9-84a3-4ed9-8419-0907e63fbc51 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1451 microversion: 2.1 time: 0.158478 Aug 08 18:22:02.075586 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 605/1173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:22:01 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:22:02.094946 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:22:02.095555 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:22:02.102315 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:22:02.102789 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:22:02.103221 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:22:02.103900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:22:02.104354 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:22:02.104804 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:22:02.231324 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:22:02.238733 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-97ba5615-f3e2-48b8-a1ba-33ab070fdae3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1451 microversion: 2.1 time: 0.147552 Aug 08 18:22:02.239281 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 569/1174] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:22:02 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:22:04.139025 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-9faaae81-5a90-4fcb-9c24-2111ce5c2a2d req-0f0e78e1-cb95-452b-86b3-a9fe1eafc06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e97e6e-e763-4415-83be-ae99380cfca9", "tag": "af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:22:04.149364 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9faaae81-5a90-4fcb-9c24-2111ce5c2a2d req-0f0e78e1-cb95-452b-86b3-a9fe1eafc06d service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:22:04.149907 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9faaae81-5a90-4fcb-9c24-2111ce5c2a2d req-0f0e78e1-cb95-452b-86b3-a9fe1eafc06d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:22:04.150397 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9faaae81-5a90-4fcb-9c24-2111ce5c2a2d req-0f0e78e1-cb95-452b-86b3-a9fe1eafc06d service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:22:04.161125 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-9faaae81-5a90-4fcb-9c24-2111ce5c2a2d req-0f0e78e1-cb95-452b-86b3-a9fe1eafc06d service nova] Creating event network-changed:af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711 for instance 93e97e6e-e763-4415-83be-ae99380cfca9 on hv-cinder-85236 Aug 08 18:22:04.166899 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-9faaae81-5a90-4fcb-9c24-2111ce5c2a2d req-0f0e78e1-cb95-452b-86b3-a9fe1eafc06d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031533 Aug 08 18:22:04.167547 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 606/1175] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:22:22.763257 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:22:22.763937 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Mon Aug 8 18:22:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:22:24.372763 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:22:24.373388 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Mon Aug 8 18:22:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:22:56.388097 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:22:56.388836 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Mon Aug 8 18:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:23:32.216636 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:32.217278 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd371ba7-3369-466a-a7ef-ecf9b6067f21] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 18:23:32.217649 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:32.217758 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:23:32.218173 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG dbcounter [-] [118382] Writing DB stats nova_cell1:SELECT=54 {{(pid=118382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:23:32.220667 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=22 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:23:32.221311 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=50 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:23:32.222881 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-1faa59d2-bc34-4ad6-b9e2-e406535dd060 req-44a411b0-ae41-443c-b021-cee18e75ad8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e97e6e-e763-4415-83be-ae99380cfca9", "tag": "af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:23:32.225060 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:32.228028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:32.228028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:32.228028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:32.228028 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:32.228541 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:32.233149 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1faa59d2-bc34-4ad6-b9e2-e406535dd060 req-44a411b0-ae41-443c-b021-cee18e75ad8e service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:32.233628 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1faa59d2-bc34-4ad6-b9e2-e406535dd060 req-44a411b0-ae41-443c-b021-cee18e75ad8e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:32.234076 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-1faa59d2-bc34-4ad6-b9e2-e406535dd060 req-44a411b0-ae41-443c-b021-cee18e75ad8e service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:32.245121 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-1faa59d2-bc34-4ad6-b9e2-e406535dd060 req-44a411b0-ae41-443c-b021-cee18e75ad8e service nova] Creating event network-changed:af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711 for instance 93e97e6e-e763-4415-83be-ae99380cfca9 on hv-cinder-85236 Aug 08 18:23:32.250483 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-1faa59d2-bc34-4ad6-b9e2-e406535dd060 req-44a411b0-ae41-443c-b021-cee18e75ad8e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035548 Aug 08 18:23:32.256672 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 607/1176] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:23:32.257349 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:23:32.599076 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1ab5f288-fb75-4b2a-94a4-f0a33dec25a3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "DELETE /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 204 len: 0 microversion: 2.1 time: 0.386632 Aug 08 18:23:32.599961 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 570/1177] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:23:32 2022] DELETE /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:23:32.610129 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:32.611059 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:32.620165 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:32.620686 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:32.621119 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:32.621823 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:32.622276 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:32.622689 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:32.789788 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:23:32.797827 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-90d4c737-c442-41ca-a51d-d6499e55c1e3 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1576 microversion: 2.1 time: 0.193730 Aug 08 18:23:32.798611 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 608/1178] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:32 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:23:33.823985 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:33.825838 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:33.831495 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:33.831994 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:33.832434 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:33.833185 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:33.833644 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:33.834341 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:33.969490 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:23:33.977376 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d2f57978-b629-48e4-a116-4dd45e84c4bd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1576 microversion: 2.1 time: 0.161804 Aug 08 18:23:33.977945 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 571/1179] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:33 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:23:34.946959 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-c46f0598-0e3e-4f7b-8e41-80828fb82ad3 req-08151367-c7ef-4d6a-b29e-0cb148eb02c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e97e6e-e763-4415-83be-ae99380cfca9", "name": "network-vif-deleted", "tag": "af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:23:34.957701 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-c46f0598-0e3e-4f7b-8e41-80828fb82ad3 req-08151367-c7ef-4d6a-b29e-0cb148eb02c8 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:34.958180 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-c46f0598-0e3e-4f7b-8e41-80828fb82ad3 req-08151367-c7ef-4d6a-b29e-0cb148eb02c8 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:34.958629 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-c46f0598-0e3e-4f7b-8e41-80828fb82ad3 req-08151367-c7ef-4d6a-b29e-0cb148eb02c8 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:34.969996 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd371ba7-3369-466a-a7ef-ecf9b6067f21] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34214. Aug 08 18:23:34.971973 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-c46f0598-0e3e-4f7b-8e41-80828fb82ad3 req-08151367-c7ef-4d6a-b29e-0cb148eb02c8 service nova] Creating event network-vif-deleted:af9a9dc3-f17d-4b30-99b2-a9bd4ed2d711 for instance 93e97e6e-e763-4415-83be-ae99380cfca9 on hv-cinder-85236 Aug 08 18:23:34.976731 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-c46f0598-0e3e-4f7b-8e41-80828fb82ad3 req-08151367-c7ef-4d6a-b29e-0cb148eb02c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033945 Aug 08 18:23:34.977322 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 609/1180] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:23:34.999020 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:34.999867 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:35.007889 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:35.008386 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:35.009005 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:35.009677 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:35.010137 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:35.010571 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:35.076204 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:23:35.084900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-99eae28a-313d-4efc-9adf-3fab6bc3a68c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1390 microversion: 2.1 time: 0.089334 Aug 08 18:23:35.085727 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 572/1181] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:34 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:23:36.106955 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:36.107602 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:36.113787 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:36.114272 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:36.114735 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:36.115471 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:36.116068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:36.116294 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:36.151068 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:36.151551 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:36.151988 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:36.152431 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lazy-loading 'fault' on Instance uuid 93e97e6e-e763-4415-83be-ae99380cfca9 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:23:36.196156 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:23:36.204130 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-92070261-3d63-4af6-9af3-6ddd382d959d tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 200 len: 1229 microversion: 2.1 time: 0.101819 Aug 08 18:23:36.204871 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 610/1182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:36 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:23:37.226594 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:37.227211 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 93e97e6e-e763-4415-83be-ae99380cfca9] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:37.233904 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:37.234385 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:37.234818 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:37.235505 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:37.235958 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:37.236521 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:37.252741 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] HTTP exception thrown: Instance 93e97e6e-e763-4415-83be-ae99380cfca9 could not be found. Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Request method failure captured: Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 HTTP/1.1 Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VLjj26Qss66Ads88BtWxkPY8_leDzU1JED4xQXsstmsx3yesASysTT0EAqhrU1NGrosg56E8-e6WH7ZntzI47ZsZ7h0eOCSt53SOVUr1ZZp9n9QhrBjP0jASVsHoHxwlJNKl66CpHu7J-FczxcbvC4s2ao58hAR5AsaDujo8WNn7A4 Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:23:37.254396 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c98de54846de4169b0ea5cca7aae3cf0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 0c911d938fd64f25844903809d56b263 Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 93e97e6e-e763-4415-83be-ae99380cfca9 could not be found. Aug 08 18:23:37.256255 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '93e97e6e-e763-4415-83be-ae99380cfca9'} Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e97e6e-e763-4415-83be-ae99380cfca9 could not be found. Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:23:37.257333 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e97e6e-e763-4415-83be-ae99380cfca9 could not be found. Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e97e6e-e763-4415-83be-ae99380cfca9 could not be found. Aug 08 18:23:37.259084 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:37.260737 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Returning 404 to user: Instance 93e97e6e-e763-4415-83be-ae99380cfca9 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:23:37.260737 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-edb2020c-f852-439d-af13-785d19cbc83c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9" status: 404 len: 111 microversion: 2.1 time: 0.033621 Aug 08 18:23:37.260737 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 573/1183] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:37 2022] GET /compute/v2.1/servers/93e97e6e-e763-4415-83be-ae99380cfca9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:23:40.531737 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:40.532292 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:40.533473 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-33305797-c555-408e-80fe-5aca5a198956 req-ae001e5f-980e-4d36-b3c2-4bf41905cc39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379c3309-85bd-41f4-b4a3-c03c7e075a60", "tag": "a48dbaea-363d-462b-8e00-191b7241d241"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:23:40.539417 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:40.540127 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:40.540592 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:40.541580 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:40.542104 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:40.542596 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:40.544594 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-33305797-c555-408e-80fe-5aca5a198956 req-ae001e5f-980e-4d36-b3c2-4bf41905cc39 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:40.545271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-33305797-c555-408e-80fe-5aca5a198956 req-ae001e5f-980e-4d36-b3c2-4bf41905cc39 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:40.545694 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-33305797-c555-408e-80fe-5aca5a198956 req-ae001e5f-980e-4d36-b3c2-4bf41905cc39 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:40.557150 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-33305797-c555-408e-80fe-5aca5a198956 req-ae001e5f-980e-4d36-b3c2-4bf41905cc39 service nova] Creating event network-changed:a48dbaea-363d-462b-8e00-191b7241d241 for instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 on hv-cinder-85236 Aug 08 18:23:40.562238 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-33305797-c555-408e-80fe-5aca5a198956 req-ae001e5f-980e-4d36-b3c2-4bf41905cc39 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032432 Aug 08 18:23:40.562817 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 574/1184] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 18:23:40.569419 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Going to try to terminate instance {{(pid=118382) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 18:23:40.839343 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-ca57de4e-9844-447b-aa76-e6aad981620a tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "DELETE /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 204 len: 0 microversion: 2.1 time: 0.311424 Aug 08 18:23:40.840171 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 611/1185] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:23:40 2022] DELETE /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 18:23:40.848616 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:40.850049 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:40.856271 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:40.856793 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:40.857238 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:40.857942 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:40.858402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:40.858830 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:40.990990 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:23:40.998506 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-59a3e9c4-36a9-4365-bd11-a2f21bdda4dc tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1575 microversion: 2.1 time: 0.154088 Aug 08 18:23:40.999103 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 575/1186] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:40 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:23:42.020696 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:42.021395 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:42.028209 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:42.028748 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:42.029200 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:42.029898 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:42.030354 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:42.030775 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:42.203337 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:23:42.211769 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-3cd316c5-66cb-4b69-94f6-cbc62d426970 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1575 microversion: 2.1 time: 0.195306 Aug 08 18:23:42.212340 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 612/1187] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:42 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:23:43.233703 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:43.234402 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:43.242050 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:43.242850 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:43.243366 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:43.244139 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:43.244700 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:43.245309 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:43.264173 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [req-9c644d29-43e6-40d1-97dd-54dcbffde2f7 req-a0ed089c-5ef2-4ea2-b21c-769cd2608db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379c3309-85bd-41f4-b4a3-c03c7e075a60", "name": "network-vif-deleted", "tag": "a48dbaea-363d-462b-8e00-191b7241d241"}]} {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 18:23:43.273843 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9c644d29-43e6-40d1-97dd-54dcbffde2f7 req-a0ed089c-5ef2-4ea2-b21c-769cd2608db5 service nova] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:43.274318 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9c644d29-43e6-40d1-97dd-54dcbffde2f7 req-a0ed089c-5ef2-4ea2-b21c-769cd2608db5 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:43.274747 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [req-9c644d29-43e6-40d1-97dd-54dcbffde2f7 req-a0ed089c-5ef2-4ea2-b21c-769cd2608db5 service nova] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:43.286525 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.compute.server_external_events [req-9c644d29-43e6-40d1-97dd-54dcbffde2f7 req-a0ed089c-5ef2-4ea2-b21c-769cd2608db5 service nova] Creating event network-vif-deleted:a48dbaea-363d-462b-8e00-191b7241d241 for instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 on hv-cinder-85236 Aug 08 18:23:43.291983 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [req-9c644d29-43e6-40d1-97dd-54dcbffde2f7 req-a0ed089c-5ef2-4ea2-b21c-769cd2608db5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031354 Aug 08 18:23:43.292599 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 613/1188] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Aug 8 18:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 18:23:43.315179 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:23:43.322831 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cfcd2905-d5eb-4773-99ee-22e3b34abd6c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1389 microversion: 2.1 time: 0.093345 Aug 08 18:23:43.325134 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 576/1189] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:43 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:23:44.344609 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:44.345308 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:44.352438 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:44.354519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:44.354519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:44.354519 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:44.354958 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:44.355115 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:44.385604 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:44.386153 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:44.386595 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:44.387048 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.objects.instance [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lazy-loading 'fault' on Instance uuid 379c3309-85bd-41f4-b4a3-c03c7e075a60 {{(pid=118382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 18:23:44.430184 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.policy [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c911d938fd64f25844903809d56b263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98de54846de4169b0ea5cca7aae3cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 18:23:44.438890 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-eb61566a-a0c6-4b22-95d0-ef50c838d22b tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 200 len: 1229 microversion: 2.1 time: 0.098450 Aug 08 18:23:44.446469 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 614/1190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:44 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 18:23:45.460210 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:45.461096 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 379c3309-85bd-41f4-b4a3-c03c7e075a60] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:45.467440 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:45.467921 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:45.468352 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:45.469058 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:45.469507 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:45.469923 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:45.483590 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] HTTP exception thrown: Instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 could not be found. Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Request method failure captured: Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 HTTP/1.1 Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VLjj26Qss66Ads88BtWxkPY8_leDzU1JED4xQXsstmsx3yesASysTT0EAqhrU1NGrosg56E8-e6WH7ZntzI47ZsZ7h0eOCSt53SOVUr1ZZp9n9QhrBjP0jASVsHoHxwlJNKl66CpHu7J-FczxcbvC4s2ao58hAR5AsaDujo8WNn7A4 Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:23:45.485190 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c98de54846de4169b0ea5cca7aae3cf0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 0c911d938fd64f25844903809d56b263 Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 could not be found. Aug 08 18:23:45.487029 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '379c3309-85bd-41f4-b4a3-c03c7e075a60'} Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 could not be found. Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:23:45.488180 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 could not be found. Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 could not be found. Aug 08 18:23:45.490086 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.492339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Returning 404 to user: Instance 379c3309-85bd-41f4-b4a3-c03c7e075a60 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:23:45.492339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9fad4268-e70c-421f-9a25-7d9d24dc641c tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60" status: 404 len: 111 microversion: 2.1 time: 0.030257 Aug 08 18:23:45.492339 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 577/1191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:45 2022] GET /compute/v2.1/servers/379c3309-85bd-41f4-b4a3-c03c7e075a60 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:23:45.964934 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:45.965453 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.compute.api [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118382) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:45.971692 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:45.972205 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:45.972660 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:45.973337 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:45.973783 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:45.974196 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG oslo_concurrency.lockutils [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:45.987574 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.wsgi [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] HTTP exception thrown: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Request method failure captured: Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: request: DELETE /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 HTTP/1.1 Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept: application/json Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Accept-Encoding: identity Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Connection: close Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Length: 0 Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Content-Type: application/json Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Host: 10.222.0.50 Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Openstack-System-Scope: None Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: User-Agent: python-urllib3/1.26.11 Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Auth-Token: gAAAAABi8VLjj26Qss66Ads88BtWxkPY8_leDzU1JED4xQXsstmsx3yesASysTT0EAqhrU1NGrosg56E8-e6WH7ZntzI47ZsZ7h0eOCSt53SOVUr1ZZp9n9QhrBjP0jASVsHoHxwlJNKl66CpHu7J-FczxcbvC4s2ao58hAR5AsaDujo8WNn7A4 Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Id: None Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Domain-Name: None Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Identity-Status: Confirmed Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Is-Admin-Project: True Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Id: default Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Domain-Name: Default Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Project-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Role: reader,member Aug 08 18:23:45.989224 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Roles: reader,member Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c98de54846de4169b0ea5cca7aae3cf0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-Tenant-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Id: default Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Domain-Name: Default Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Id: 0c911d938fd64f25844903809d56b263 Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: X-User-Name: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: method: > Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: exception: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:45.991177 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: action_args: {'id': '6363da42-8d2d-4e98-aabc-46fa6ca81bd7'} Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:23:45.992166 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:45.994043 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: ERROR nova.api.openstack.wsgi Aug 08 18:23:45.995653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Returning 404 to user: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. {{(pid=118382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:23:45.995653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-e9954550-af34-430b-8963-2bf3d76c6bbd tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 404 len: 111 microversion: 2.1 time: 0.029903 Aug 08 18:23:45.995653 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 615/1192] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Aug 8 18:23:45 2022] DELETE /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:23:46.001182 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:46.001796 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] [instance: 6363da42-8d2d-4e98-aabc-46fa6ca81bd7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 18:23:46.007745 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:46.008222 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:46.008691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:46.009380 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Acquiring lock "320277b0-4e75-45a4-acb0-6acffeb7474a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 18:23:46.009837 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 18:23:46.010259 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Lock "320277b0-4e75-45a4-acb0-6acffeb7474a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 18:23:46.024241 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] HTTP exception thrown: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Request method failure captured: Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 HTTP/1.1 Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Connection: close Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Host: 10.222.0.50 Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi8VLjj26Qss66Ads88BtWxkPY8_leDzU1JED4xQXsstmsx3yesASysTT0EAqhrU1NGrosg56E8-e6WH7ZntzI47ZsZ7h0eOCSt53SOVUr1ZZp9n9QhrBjP0jASVsHoHxwlJNKl66CpHu7J-FczxcbvC4s2ao58hAR5AsaDujo8WNn7A4 Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Role: reader,member Aug 08 18:23:46.025756 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Roles: reader,member Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c98de54846de4169b0ea5cca7aae3cf0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c98de54846de4169b0ea5cca7aae3cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}] Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Id: c98de54846de4169b0ea5cca7aae3cf0 Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-TestVolumeBootPattern-73603540 Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Id: 0c911d938fd64f25844903809d56b263 Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-TestVolumeBootPattern-73603540-project Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: method: > Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: exception: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:46.027491 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: action_args: {'id': '6363da42-8d2d-4e98-aabc-46fa6ca81bd7'} Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 18:23:46.028597 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. Aug 08 18:23:46.030217 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 08 18:23:46.031691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Returning 404 to user: Instance 6363da42-8d2d-4e98-aabc-46fa6ca81bd7 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 18:23:46.031691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-55ca00a4-a007-4d24-b5c9-70b334ab3165 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7" status: 404 len: 111 microversion: 2.1 time: 0.029812 Aug 08 18:23:46.031691 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 578/1193] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Aug 8 18:23:45 2022] GET /compute/v2.1/servers/6363da42-8d2d-4e98-aabc-46fa6ca81bd7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 18:23:47.515053 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: DEBUG nova.api.openstack.wsgi [None req-2490ecc3-f9a5-4112-baf0-293d239043e0 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] Calling method '.version_select at 0x7f21b1817a60>' {{(pid=118382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 18:23:47.603508 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO nova.api.openstack.requestlog [None req-2490ecc3-f9a5-4112-baf0-293d239043e0 tempest-TestVolumeBootPattern-73603540 tempest-TestVolumeBootPattern-73603540-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-605769720" status: 202 len: 0 microversion: 2.1 time: 0.092296 Aug 08 18:23:47.604122 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: [pid: 118382|app: 0|req: 616/1194] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Aug 8 18:23:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-605769720 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 18:24:15.641266 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:24:15.647100 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Mon Aug 8 18:24:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:25:44.381175 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:25:44.381809 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Mon Aug 8 18:25:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:26:16.396198 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:26:16.396925 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Mon Aug 8 18:26:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:27:35.649194 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:27:35.649753 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Mon Aug 8 18:27:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:29:02.775161 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:29:02.775890 dv-cinder-852364-1-iscsi devstack@n-api.service[118382]: Mon Aug 8 18:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 18:29:04.389308 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 18:29:04.389900 dv-cinder-852364-1-iscsi devstack@n-api.service[118381]: Mon Aug 8 18:29:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!